文献速递药物不良反应与药物警戒

社交媒体用于广泛药物警戒统计信号检测的效用评估:WEB-RADR项目结果

Assessment of the Utility of Social Media for Broad-Ranging Statistical Signal Detection in Pharmacovigilance: Results from the WEB-RADR Project.
PubMed 文献 · Drug Saf · 2018-01-01

本研究评估了Twitter/Facebook中已建立的统计信号检测算法对广泛药物和不良事件的性能,使用Harpaz参考集(62个美国FDA标签变更)和内部WEB-RADR参考集(200个验证安全信号),共研究75种药物。结果显示,Twitter/Facebook的AUC在0.47-0.53之间,而VigiBase为0.55-0.69,表明社交媒体信号检测性能差,不推荐替代其他药物警戒活动。

要点

  • Twitter/Facebook的AUC仅为0.47-0.53,接近随机水平。
  • VigiBase的AUC为0.55-0.69,优于社交媒体。
  • 社交媒体仅检测到6%-16%的阳性对照,提前于索引日期。

核心结论

  • 在Twitter和Facebook中使用当前可用方法进行广泛统计信号检测性能差,不推荐以牺牲其他药物警戒活动为代价。

研究设计与样本

  • 使用Harpaz等参考集(62个美国FDA标签变更)和内部WEB-RADR参考集(200个验证安全信号),共研究75种药物。
  • 检索2012年3月至2015年3月期间的Twitter/Facebook帖子,并从VigiBase提取同期个例报告。

主要发现

  • Twitter/Facebook的AUC在WEB-RADR参考集为0.47-0.53,在Harpaz参考集为0.48-0.53。
  • VigiBase的AUC在WEB-RADR参考集为0.64-0.69,在Harpaz参考集为0.55-0.67。
  • 在Twitter/Facebook中,WEB-RADR和Harpaz参考集分别最多检测到31个(16%)和4个(6%)阳性对照提前于索引日期。
  • 在VigiBase中,相应数字分别为66个(33%)和17个(27%)。

临床怎么用

  • 临床药学智能体应优先使用VigiBase等传统药物警戒数据库进行信号检测,而非社交媒体。
  • 不建议将Twitter/Facebook作为广泛药物警戒信号检测的主要数据源。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

INTRODUCTION AND OBJECTIVE: Social media has been proposed as a possibly useful data source for pharmacovigilance signal detection. This study primarily aimed to evaluate the performance of established statistical signal detection algorithms in Twitter/Facebook for a broad range of drugs and adverse events. METHODS: Performance was assessed using a reference set by Harpaz et al., consisting of 62 US Food and Drug Administration labelling changes, and an internal WEB-RADR reference set consisting of 200 validated safety signals. In total, 75 drugs were studied. Twitter/Facebook posts were retrieved for the period March 2012 to March 2015, and drugs/events were extracted from the posts. We retrieved 4.3 million and 2.0 million posts for the WEB-RADR and Harpaz drugs, respectively. Individual case reports were extracted from VigiBase for the same period. Disproportionality algorithms based on the Information Component or the Proportional Reporting Ratio and crude post/report counting were applied in Twitter/Facebook and VigiBase. Receiver operating characteristic curves were generated, and the relative timing of alerting was analysed. RESULTS: Across all algorithms, the area under the receiver operating characteristic curve for Twitter/Facebook varied between 0.47 and 0.53 for the WEB-RADR reference set and between 0.48 and 0.53 for the Harpaz reference set. For VigiBase, the ranges were 0.64-0.69 and 0.55-0.67, respectively. In Twitter/Facebook, at best, 31 (16%) and four (6%) positive controls were detected prior to their index dates in the WEB-RADR and Harpaz references, respectively. In VigiBase, the corresponding numbers were 66 (33%) and 17 (27%). CONCLUSIONS: Our results clearly suggest that broad-ranging statistical signal detection in Twitter and Facebook, using currently available methods for adverse event recognition, performs poorly and cannot be recommended at the expense of other pharmacovigilance activities.

来源:Drug Saf,查看原文。版权归原作者所有。

引用

  1. Caster O, Dietrich J, Kürzinger ML, et al. Assessment of the Utility of Social Media for Broad-Ranging Statistical Signal Detection in Pharmacovigilance: Results from the WEB-RADR Project. Drug Saf. 2018. PMID: 30043385. doi:10.1007/s40264-018-0699-2

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。