结合机器学习与规则算法检测出院小结中药物不良事件相关实体
本研究开发了一种结合规则与机器学习的混合模型,用于从出院小结中识别相关的药物-不良事件对。模型在时间与地理外部验证集上召回率为0.76-0.80,但规则限制使召回率降低约12-14%,同时提升实体识别准确性。
要点
- 混合模型在仅含规则内文本段的数据集上召回率达0.76-0.80。
- 规则限制检测空间使召回率降低约12-14%,但改善药物与不良事件术语识别。
- 模型在时间和地理外部验证集上表现出合理泛化能力。
核心结论
- 混合模型在外部验证上展现合理泛化性,规则限制检测空间使召回率降低约12-14%但改善相关药物与不良事件术语识别。
研究设计与样本
- 开发结合规则与机器学习算法的混合模型,使用出院小结,并在四个独立数据集(时间与地理分离)上验证。
主要发现
- 在仅含符合规则算法标准的预识别目标文本段数据集上,混合模型召回率为0.80(五折交叉验证)、0.80(时间验证)和0.76(地理验证)。
- 在额外包含不受规则标准限制的药物-不良事件对的数据集上,模型召回率在时间与地理分离数据集分别降至0.68和0.62。
- 规则限制检测空间导致召回率降低约12-14%。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: Discharge summaries contain valuable information about adverse drug reactions, but their unstructured nature makes them challenging to analyse and use as a signal source for pharmacovigilance. Machine learning has shown promise in identifying discharge summaries that contain related drug-adverse event pairs but has fared relatively poorer in entity extraction. METHODS: A hybrid model is developed combining rule-based and machine learning algorithms using discharge summaries with the aim of maximising capture of related drug-adverse event pairs. The rule first identifies segments containing adverse event entities within a 100-character distance from a drug term; machine learning subsequently estimates the relatedness of the drug and adverse event entities contained. The approach is validated on four independent datasets that are temporally and geographically separated from model development data. The impact of restricted drug-adverse event pair detection on recall is evaluated by using two of the four validation datasets that do not impose rule-based restrictions to annotations. RESULTS: The hybrid model achieves a recall of 0.80 (fivefold cross validation), 0.80 (temporal) and 0.76 (geographical) on validation using datasets containing only pre-identified target text segments that fulfil the rule-based algorithm criteria. When tested on datasets that additionally contained drug-adverse event pairs not restricted by the rule-based criteria, recall of the model declines to 0.68 and 0.62 on temporally and geographically separated datasets, respectively. CONCLUSIONS: The proposed hybrid model demonstrates reasonable generalisability on external validation. Rule-based restriction of the detection space results in an approximately 12-14% reduction in recall but improves identification of the related drug and adverse event terms.
引用
- Tan HX, Teo CHD, Ang PS, et al. Combining Machine Learning with a Rule-Based Algorithm to Detect and Identify Related Entities of Documented Adverse Drug Reactions on Hospital Discharge Summaries. Drug Saf. 2022. PMID: 35794349. doi:10.1007/s40264-022-01196-x
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。