面向自动化不良事件审查:病例报告效用预测模型的开发与验证
本研究基于FDA不良事件报告系统数据库,开发并验证了一个预测个例安全报告(ICSR)药物警戒效用(PVU)的模型。PVU定义为ICSR被纳入FDA药物警戒审查病例系列并支持修改产品标签。多变量逻辑回归显示,指定医学事件报告(OR 1.93,95%CI 1.54-2.43)和阳性再激发(OR 1.67,95%CI 1.50-1.87)是ICSR纳入的最强预测因子;验证模型区分度中等(C统计量0.71),且在不同安全问题上表现异质(C统计量范围0.58-0.74)。
要点
- 指定医学事件报告和阳性再激发与ICSR被纳入药物警戒审查病例系列正相关。
- 死亡作为唯一结局、超过3种可疑产品、报告超过15个首选术语与ICSR被排除相关。
- 模型区分度中等(C统计量0.71),提示需进一步优化并可能需针对安全问题定制算法。
核心结论
- 开发预测ICSR药物警戒效用的模型具有可行性,但区分度中等,需进一步改进。
研究设计与样本
- 基于FDA不良事件报告系统数据库,纳入69项药物警戒审查中评估的10,381份ICSR,其中2,115份被纳入病例系列。
- 采用多变量逻辑回归模型分析ICSR特征与PVU的关联,选择最佳模型进行自举验证,并按安全问题亚组进行敏感性分析。
主要发现
- ICSR纳入的最强预测因子为报告指定医学事件(OR 1.93,95%CI 1.54-2.43)和阳性再激发(OR 1.67,95%CI 1.50-1.87)。
- ICSR排除的最强预测因子为死亡作为唯一结局(OR 2.72,95%CI 1.76-4.35)、超过3种可疑产品(OR 2.69,95%CI 2.23-3.24)和报告超过15个首选术语(OR 2.69,95%CI 1.90-3.82)。
- 验证模型区分度中等(C统计量0.71),敏感性分析显示模型性能随安全问题异质(C统计量范围0.58-0.74)。
临床怎么用
- 该模型可作为药物警戒中识别高效用ICSR的辅助工具,但需结合安全问题类型谨慎解读。
局限性
- 模型区分度中等,在不同安全问题中性能异质,提示算法可能需针对特定安全问题定制。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: The rapidly expanding size of the Food and Drug Administration's (FDA) Adverse Event Reporting System database requires modernized pharmacovigilance practices. Techniques to systematically identify high utility individual case safety reports (ICSRs) will support safety signal management. OBJECTIVES: The aim of this study was to develop and validate a model predictive of an ICSR's pharmacovigilance utility (PVU). METHODS: PVU was operationalized as an ICSR's inclusion in an FDA-authored pharmacovigilance review's case series supporting a recommendation to modify product labeling. Multivariable logistic regression models were used to examine the association between PVU and ICSR features. The best performing model was selected for bootstrapping validation. As a sensitivity analysis, we evaluated the model's performance across subgroups of safety issues. RESULTS: We identified 10,381 ICSRs evaluated in 69 pharmacovigilance reviews, of which 2115 ICSRs were included in a case series. The strongest predictors of ICSR inclusion were reporting of a designated medical event (odds ratio (OR) 1.93, 95% CI 1.54-2.43) and positive dechallenge (OR 1.67, 95% CI 1.50-1.87). The strongest predictors of ICSR exclusion were death reported as the only outcome (OR 2.72, 95% CI 1.76-4.35), more than three suspect products (OR 2.69, 95% CI 2.23-3.24), and > 15 preferred terms reported (OR 2.69, 95% CI 1.90-3.82). The validated model showed modest discriminative ability (C-statistic of 0.71). Our sensitivity analysis demonstrated heterogeneity in model performance by safety issue (C-statistic range 0.58-0.74). CONCLUSIONS: Our model demonstrated the feasibility of developing a tool predictive of ICSR utility. The model's modest discriminative ability highlights opportunities for further enhancement and suggests algorithms tailored to safety issues may be beneficial.
引用
- Muñoz MA, Dal Pan GJ, Wei YJ, et al. Towards Automating Adverse Event Review: A Prediction Model for Case Report Utility. Drug Saf. 2020. PMID: 31912439. doi:10.1007/s40264-019-00897-0
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。