ChatGPT在临床药学中的表现评估:与临床药师的对比研究
该研究通过真实临床病例和临床药师能力考核收集问题,比较ChatGPT与临床药师在处方审核、患者用药教育、药品不良反应(ADR)识别、ADR因果关系评估和用药咨询中的表现。5名持证临床药师独立评分(0–10分),结果显示ChatGPT在用药咨询方面表现优秀,但在处方审核、患者用药教育、ADR识别和ADR因果关系评估方面较弱。结论认为ChatGPT可作为临床药学的辅助工具,但处理复杂问题的能力需进一步改进。
要点
- ChatGPT具备强大的检索、信息整合和对话能力,但缺乏药学专用数据集及高级推理和复杂指令处理能力。
核心结论
- ChatGPT在临床药学实践中作为辅助工具有前景,但处理复杂问题的能力需进一步改进和完善。
研究设计与样本
- 研究从真实临床病例和临床药师能力考核中收集问题及临床药师答案,将相同问题输入ChatGPT Mar 23版本生成回答,由5名持证临床药师独立按0(完全错误)至10(完全正确)评分,采用配对双尾Student t检验比较均值。
关键数值与推荐
- 评分采用0分(完全错误)至10分(完全正确)量表,由5名持证临床药师独立评定。
临床怎么用
- ChatGPT可作为临床药学的辅助工具,尤其在用药咨询方面。
- 在处方审核、患者用药教育、ADR识别和ADR因果关系评估中,不应依赖ChatGPT替代临床药师。
局限性
- ChatGPT缺乏药学专用数据集,且处理高级推理和复杂指令的能力不足。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
AIMS: To evaluate the performance of chat generative pretrained transformer (ChatGPT) in key domains of clinical pharmacy practice, including prescription review, patient medication education, adverse drug reaction (ADR) recognition, ADR causality assessment and drug counselling. METHODS: Questions and clinical pharmacist's answers were collected from real clinical cases and clinical pharmacist competency assessment. ChatGPT's responses were generated by inputting the same question into the 'New Chat' box of ChatGPT Mar 23 Version. Five licensed clinical pharmacists independently rated these answers on a scale of 0 (Completely incorrect) to 10 (Completely correct). The mean scores of ChatGPT and clinical pharmacists were compared using a paired 2-tailed Student's t-test. The text content of the answers was also descriptively summarized together. RESULTS: The quantitative results indicated that ChatGPT was excellent in drug counselling (ChatGPT: 8.77 vs. clinical pharmacist: 9.50, P = .0791) and weak in prescription review (5.23 vs. 9.90, P = .0089), patient medication education (6.20 vs. 9.07, P = .0032), ADR recognition (5.07 vs. 9.70, P = .0483) and ADR causality assessment (4.03 vs. 9.73, P = .023). The capabilities and limitations of ChatGPT in clinical pharmacy practice were summarized based on the completeness and accuracy of the answers. ChatGPT revealed robust retrieval, information integration and dialogue capabilities. It lacked medicine-specific datasets as well as the ability for handling advanced reasoning and complex instructions. CONCLUSIONS: While ChatGPT holds promise in clinical pharmacy practice as a supplementary tool, the ability of ChatGPT to handle complex problems needs further improvement and refinement.
引用
- Huang X, Estau D, Liu X, et al. Evaluating the performance of ChatGPT in clinical pharmacy: A comparative study of ChatGPT and clinical pharmacists. Br J Clin Pharmacol. 2023. PMID: 37626010. doi:10.1111/bcp.15896
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。