文献速递药物不良反应与药物警戒

人工智能用于非结构化医疗数据:患者报告药品不良反应的编码应用

Artificial Intelligence for Unstructured Healthcare Data: Application to Coding of Patient Reporting of Adverse Drug Reactions.
PubMed 文献 · Clin Pharmacol Ther · 2021-05-08

本研究基于法国药物警戒中心2017年3月至2019年3月通过国家门户网站收集的患者报告药品不良反应数据(n=2,058份报告),开发了一套结合知识库与监督机器学习模型的自动化编码系统。研究比较了传统机器学习与深度学习模型,最佳模型为梯度提升树(LGBM),内部验证AUC为0.93(0.92-0.94),F-measure为0.72(0.68-0.75);外部验证(n=187)AUC为0.91,F-measure为0.58。结果表明人工智能流程能够从非结构化数据中学习正确识别药品不良反应。

要点

  • 梯度提升树模型在识别患者报告药品不良反应上表现最佳,内部验证AUC达0.93。
  • 外部验证AUC为0.91但F-measure降至0.58,提示泛化性能仍需提升。
  • 该系统可辅助药物警戒人员从非结构化文本中自动化编码药品不良反应。

核心结论

  • 人工智能流程能够从非结构化患者报告数据中学习正确识别药品不良反应。
  • 梯度提升树(LGBM)模型在内部验证中表现最佳,外部验证性能有所下降。

研究设计与样本

  • 研究基于法国药物警戒中心2017年3月至2019年3月通过国家门户网站收集的患者报告药品不良反应数据(n=2,058份报告)训练模型。
  • 采用外部验证数据集为马赛药物警戒中心同期随机抽样的药品不良反应报告(n=187)。
  • 比较了传统机器学习模型与深度学习模型。

主要发现

  • 内部验证中,梯度提升树(LGBM)模型识别药品不良反应的AUC为0.93(0.92-0.94),F-measure为0.72(0.68-0.75)。
  • 外部验证中,该模型AUC为0.91,F-measure为0.58。

临床怎么用

  • 该人工智能系统可作为药物警戒编码辅助工具,帮助处理非结构化患者报告文本。
  • 外部验证F-measure降低提示实际部署前需进一步优化模型泛化能力。

局限性

  • 外部验证F-measure(0.58)低于内部验证(0.72),提示模型在不同数据集上性能下降。
  • 研究仅基于法国药物警戒中心数据,外推至其他地区或语言环境需谨慎。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

Adverse drug reaction (ADR) reporting is a major component of drug safety monitoring; its input will, however, only be optimized if systems can manage to deal with its tremendous flow of information, based primarily on unstructured text fields. The aim of this study was to develop an automated system allowing to code ADRs from patient reports. Our system was based on a knowledge base about drugs, enriched by supervised machine learning (ML) models trained on patients reporting data. To train our models, we selected all cases of ADRs reported by patients to a French Pharmacovigilance Centre through a national web-portal between March 2017 and March 2019 (n = 2,058 reports). We tested both conventional ML models and deep-learning models. We performed an external validation using a dataset constituted of a random sample of ADRs reported to the Marseille Pharmacovigilance Centre over the same period (n = 187). Here, we show that regarding area under the curve (AUC) and F-measure, the best model to identify ADRs was gradient boosting trees (LGBM), with an AUC of 0.93 (0.92-0.94) and F-measure of 0.72 (0.68-0.75). This model was run for external validation showing an AUC of 0.91 and a F-measure of 0.58. We evaluated an artificial intelligence pipeline that was found able to learn how to identify correctly ADRs from unstructured data. This result allowed us to start a new study using more data to further improve our performance and offer a tool that is useful in practice to efficiently manage drug safety information.

来源:Clin Pharmacol Ther,查看原文。版权归原作者所有。

引用

  1. Létinier L, Jouganous J, Benkebil M, et al. Artificial Intelligence for Unstructured Healthcare Data: Application to Coding of Patient Reporting of Adverse Drug Reactions. Clin Pharmacol Ther. 2021. PMID: 33866552. doi:10.1002/cpt.2266

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。