文献速递药物不良反应与药物警戒药物相互作用

评估GPT-4回答疼痛治疗临床药理学问题的准确性

Assessing GPT-4's accuracy in answering clinical pharmacological questions on pain therapy.
PubMed 文献 · Br J Clin Pharmacol · 2025-03-11

本研究通过横断面调查,由医生和药师提交最多8个疼痛管理相关的临床药理学问题(涉及药物相互作用、剂量和禁忌症),评估GPT-4回答的可理解性、细节、满意度、医学药理学准确性和完整性,并与德国药物目录比较。结果显示99%参与者认为回答可理解,96%认为医学准确,但仅63%认为信息完整,系统可用性量表得分为83.38(±10.26)。结论认为GPT-4有潜力但需进一步完善。

要点

  • GPT-4回答在可理解性和医学准确性上获得高评价,但完整性不足。
  • 药代动力学和药物相互作用数据存在缺口。
  • 系统可用性量表得分为83.38(±10.26),评价良好至优秀。

核心结论

  • GPT-4在提供疼痛管理医学信息方面显示出潜力,但药理学数据不完整和后续问题中潜在的上下文残留提示需要进一步改进。

研究设计与样本

  • 横断面调查基于研究,由医生和药师参与,参与者提交最多8个关于疼痛管理的临床药理学问题。

主要发现

  • 99%的参与者认为GPT-4的回答可理解。
  • 84%的参与者认为信息足够详细。
  • 93%的参与者表示满意,96%认为回答医学准确。
  • 仅63%的参与者认为信息完整,部分指出药代动力学和药物相互作用数据存在缺口。
  • 系统可用性量表得分为83.38(±10.26),评价为良好至优秀。

局限性

  • 药理学数据不完整。
  • 后续问题中可能存在上下文残留。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

AIMS: This study aimed to evaluate the accuracy and completeness of GPT-4, a large language model, in answering clinical pharmacological questions related to pain therapy, with a focus on its potential as a tool for delivering patient-facing medical information. The objective was to assess its reliability in delivering medical information in the context of pain management. METHODS: A cross-sectional survey-based study was conducted with healthcare professionals, including physicians and pharmacists. Participants submitted up to 8 clinical pharmacology questions on pain management, focusing on drug interactions, dosages and contraindications. GPT-4's responses were evaluated based on comprehensibility, detail, satisfaction, medical-pharmacological accuracy and completeness. Additionally, responses were compared to the German Drug Directory to assess their accuracy. RESULTS: The majority of participants (99%) found GPT-4's responses comprehensible, while 84% considered the information detailed enough. Overall satisfaction was high, with 93% expressing satisfaction, and 96% deemed the responses medically accurate. However, only 63% rated the information as complete, with some identifying gaps in pharmacokinetics and drug interaction data. Usability was evaluated as good to excellent, with a System Usability Scale score of 83.38 (± 10.26). CONCLUSION: GPT-4 demonstrates potential as a tool for delivering medical information, particularly in pain management. However, limitations such as incomplete pharmacological data and the potential for contextual carryover in follow-up questions suggest that further refinement is necessary. Developing specialized artificial intelligence tools that integrate real-time pharmacological databases could improve accuracy and reliability for clinical decision-making.

来源:Br J Clin Pharmacol,查看原文。版权归原作者所有。

引用

  1. Stroop A, Stroop T, Zawy Alsofy S, et al. Assessing GPT-4's accuracy in answering clinical pharmacological questions on pain therapy. Br J Clin Pharmacol. 2025. PMID: 40066678. doi:10.1002/bcp.70036

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。