利用大语言模型从处方药标签中提取药物安全性信息
本研究比较了GPT、Llama和Mixtral等多种生成式大语言模型与两种基线方法在从结构化产品标签(SPL)中提取不良反应(AR)任务上的表现,并探索了提示策略和术语复杂度等因素的影响。结果显示GPT-4无需额外训练或微调即可匹配或超越先前最先进模型的性能,且在无需标注数据的药物相互作用章节药物名称提取任务中展现出泛化能力。
要点
- GPT-4无需额外训练即可在SPL不良反应提取中匹配或超越先前最先进模型。
- SPL章节、上下文和AR术语复杂度影响生成式模型的提取性能。
- 生成式模型可泛化至无标注数据的药物相互作用章节提取药物名称。
核心结论
- 生成式大语言模型在自动化提取SPL药物安全性信息方面具有显著潜力,有望改善上市后监测并减少ADRs。
研究设计与样本
- 比较多种生成式LLM(GPT、Llama、Mixtral)与两种基线方法在从SPL提取AR任务上的性能,并探索提示策略和术语复杂度的影响。
- 在无额外微调或训练的情况下,将生成式模型应用于SPL药物相互作用章节的药物名称提取任务以展示灵活性。
主要发现
- GPT-4无需额外训练或微调即可匹配或超越先前最先进模型的性能。
- SPL的具体章节、周围上下文和AR术语的复杂度影响提取性能。
- 生成式模型在无 curated 训练数据的药物相互作用章节药物名称提取任务中展现出泛化能力。
临床怎么用
- 可考虑使用生成式大语言模型(如GPT-4)辅助从SPL中自动化提取不良反应和药物相互作用信息,以支持药物安全性研究。
局限性
- 未来工作需聚焦于优化提示策略并扩展模型能力以处理日益复杂和细微的药物安全性信息。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: Adverse drug reactions (ADRs), including those resulting from drug interactions, remain a leading cause of morbidity and mortality. Structured product labels (SPLs) serve as a primary source for drug safety information. Having machine-readable product labels, including adverse reactions (ARs) and drug interactions, readily available would allow researchers to streamline medication safety studies. However, extracting this information is complex and requires the use of natural language processing (NLP) methods. OBJECTIVE: In this study, we explored the application of generative language models in the extraction of drug safety information from SPLs. METHODS: We compared multiple generative LLMs (GPT, Llama, and Mixtral) to two baseline methods in the task of extracting adverse reactions (ARs) from SPLs. We explored various factors, such as prompting strategies and term complexity, that impact the performance of these models in the extraction of ARs. Finally, we explored the generative models' capacity to extract drug interactions from a separate section of SPLs without additional fine-tuning or training, demonstrating their flexibility and adaptability for information retrieval. RESULTS: We found that generative language models, specifically GPT-4, are able to match or exceed the performance of previous state-of-the-art models without additional training or fine-tuning. Additionally, we found that the specific SPL section, surrounding context, and complexity of the AR term impacted the extraction performance. Finally, we demonstrated the generalizability of these models by applying them to a separate task of extracting drug names from the drug interaction section where curated training data are not available. CONCLUSION: Generative language models demonstrate significant potential for automating drug safety information extraction from SPLs, offering a promising avenue for improving post-market surveillance and reducing ADRs. Future work should focus on refining prompting strategies and expanding the models' capabilities to handle increasingly complex and nuanced drug safety information.
引用
- Gisladottir U, Zietz M, Kivelson S, et al. Leveraging Large Language Models in Extracting Drug Safety Information from Prescription Drug Labels. Drug Saf. 2025. PMID: 40892374. doi:10.1007/s40264-025-01594-x
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。