免费大语言模型对急性肾损伤及连续肾脏替代治疗患者精准给药推荐的不准确与不一致性
该病例系列研究于2025年7月至9月由6名研究者使用三种标准化 vignettes 查询6种免费大语言模型(ChatGPT、Claude、Google Gemini、Microsoft Copilot、OpenEvidence、Perplexity),评估其对头孢吡肟和美罗培南在急性肾损伤及连续肾脏替代治疗患者中的给药推荐与文献的一致性及内部一致性。结果显示平均文献一致性为63%(范围28%-94%),同一用户多次迭代间每日维持剂量推荐变异达0-1000%,仅OpenEvidence普遍引用相关来源,所有模型均推荐治疗药物监测但仅Claude一致承认自身不确定性。结论认为免费大语言模型输出高度变异且常与文献不一致,不应单独用于危重肾功能不全患者的药物剂量决策。
要点
- 免费大语言模型对AKI及CKRT患者的抗生素剂量推荐与文献平均一致性仅63%(范围28%-94%)。
- 同一模型多次迭代间每日维持剂量推荐变异可达0-1000%,内部一致性差。
- 所有模型均推荐TDM,但仅Claude一致承认自身不确定性,OpenEvidence普遍引用来源。
核心结论
- 免费大语言模型对AKI及CKRT患者的抗生素剂量推荐高度变异且常与文献不一致,不应单独用于药物剂量决策。
研究设计与样本
- 病例系列研究:6名研究者于2025年7月至9月查询6种免费大语言模型(ChatGPT、Claude、Google Gemini、Microsoft Copilot、OpenEvidence、Perplexity),使用三种标准化 vignettes 评估头孢吡肟和美罗培南的给药推荐。
主要发现
- 大语言模型生成的剂量推荐差异广泛,与文献推荐的平均一致性为63%(范围28%-94%)。
- 同一用户多次迭代同一 vignette 时,每日维持剂量推荐的变异范围为0至1000%。
- OpenEvidence普遍引用相关来源,其他模型引用来源不一致或虚构来源;所有模型均推荐TDM,但仅Claude一致承认自身不确定性。
临床怎么用
- 大语言模型可用于假设生成和文献检索,但不应单独用于危重肾功能不全患者的药物剂量推荐。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: Evidence-based dosing guidance for medications in critically ill patients with acute kidney injury (AKI) and receiving continuous kidney replacement therapy (CKRT) is limited. Freely available large language models (LLMs) can generate confident, human-like outputs. The accuracy and reproducibility of LLMs in providing precision drug dosing recommendations in the setting of AKI and CKRT have not been evaluated. OBJECTIVES: We sought to characterize literature concordance and internal consistency of LLM-generated dosing recommendations for cefepime and meropenem in patients with AKI and receiving CKRT. METHODS: Six investigators queried the freely available versions of six LLMs (ChatGPT, Claude, Google Gemini, Microsoft Copilot, OpenEvidence, and Perplexity) from July to September 2025 using three standardized vignettes asking for dosing recommendations and rationale to meet prespecified pharmacodynamic targets: (i) adult with AKI not on dialysis receiving cefepime, (ii) child receiving CKRT and cefepime, and (iii) toddler receiving high-effluent CKRT and meropenem. To assess inter-iteration consistency, each investigator also prompted one LLM three times for each vignette. Responses were parsed for concordance with recommendations in primary literature. LLM "reasoning" was evaluated for use of pharmacokinetic (PK) equations, citation accuracy versus confabulation, acknowledgment of uncertainty, and recommendations for therapeutic drug monitoring (TDM) for efficacy or safety. RESULTS: LLM-generated dosing recommendations varied widely. Mean concordance with literature-based recommendations was 63% (range: 28%-94%). LLMs produced variable responses to the same user upon multiple iterations, with variance in daily maintenance doses recommended ranging from 0 to 1000%. OpenEvidence universally cited relevant sources, whereas other LLMs leveraged sources inconsistently or confabulated them. Each recommended TDM, though only Claude consistently acknowledged its own uncertainty. CONCLUSION: Freely available LLMs produce highly variable and often discordant antibiotic dosing recommendations for patients with AKI and receiving CKRT. Although valuable for hypothesis generation and literature retrieval, LLM outputs should not be used in isolation for drug dosing in critically ill patients with kidney dysfunction.
引用
- Hambrick HR, Dubinsky S, Quickfall D, et al. User Beware: Inaccuracy and Inconsistency of Large Language Models in Providing Precision Dosing Recommendations for Patients With Kidney Impairment-A Case Series. Pharmacotherapy. 2026. PMID: 42817723. doi:10.1002/phar.70207
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。