ChatGPT辅助反思推理对介入放射科医生决策的影响
本研究通过标准化临床场景,评估ChatGPT辅助反思推理对早期介入放射科医生遵循指南决策的影响。结果显示,辅助后医生的指南一致性评分显著提高,不适当决策减少,与专家共识的一致性增强。结论支持大语言模型作为早期临床实践中的认知支持工具。
要点
- ChatGPT辅助反思推理可提高早期介入放射科医生的指南遵循度。
- 辅助后不适当决策显著减少,与专家共识一致性增强。
- 大语言模型有望成为介入放射科早期临床实践的认知支持工具。
核心结论
- ChatGPT辅助反思推理显著提高了早期介入放射科医生的指南遵循度和决策质量。
- 大语言模型作为认知支持工具,在早期临床实践中具有潜在应用价值。
研究设计与样本
- 前瞻性模拟研究,纳入128个介入放射学标准化临床场景。
- 两位介入放射学专家作为参考标准,三位早期职业放射科医生独立完成所有场景。
- 场景完成两次:首次独立(ChatGPT前),两月洗脱期后ChatGPT辅助下完成(ChatGPT后)。
诊断标准与关键数值
- 指南遵循度采用三级评分:适宜=2分,可能适宜=1分,不适宜=0分。
- 平均详细依从评分由1.697升高至1.900(ChatGPT前 vs ChatGPT后)。
- 最低依从率由90.89%提升至98.70%(ChatGPT前 vs ChatGPT后)。
- 30个场景级决策由不适宜修正为遵循指南(McNemar χ²=27.03,p<0.0001)。
- 加权Cohen's kappa由0.08-0.13增加至0.21-0.30,与专家一致性提高。
临床应用与阅片要点
- ChatGPT辅助反思推理可用于提高介入放射科医生指南遵循度,减少不适宜操作选择。
- 早期职业医生在复杂介入决策前使用大语言模型辅助反思有助于缩小与专家的差距。
- 该工具可降低决策变异度,提升决策稳定性。
局限性
- 模拟场景研究,尚需真实世界前瞻性验证。
- 仅三位早期职业医生参与,样本量有限。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
RATIONALE AND OBJECTIVES: This study aims to evaluate the effect of ChatGPT-assisted reflective reasoning on guideline-concordant procedural decision-making among early-career interventional radiologists using standardized clinical scenarios based on the American College of Radiology Appropriateness Criteria.
MATERIALS AND METHODS: This prospective simulation-based study included 128 scenarios across common interventional radiology indications. Two expert interventional radiologists served as the reference standard. Three early-career radiologists completed all scenarios twice: first independently (pre-ChatGPT) and, after a two-month washout period, with access to ChatGPT-generated reasoning before recording final decisions (post-ChatGPT). Guideline concordance was assessed using a three-tier scoring system (appropriate = 2, may be appropriate = 1, inappropriate = 0) and a binary score reflecting avoidance of inappropriate decisions. Predifferences and postdifferences were analyzed with Wilcoxon signed-rank and McNemar tests. Agreement with experts was measured using Cohen's kappa.
RESULTS: ChatGPT-assisted reflective reasoning significantly improved guideline-concordant decision-making. The mean detailed compliance score increased from 1.697 to 1.900, and minimal compliance enhanced from 90.89% to 98.70%. A total of 30 scenario-level corrections shifted from inappropriate to guideline-concordant selections (McNemar χ² = 27.03; p < 0.0001). Detailed compliance improved significantly for all radiologists (p < 0.01). Weighted Cohen's kappa increased from 0.08-0.13 to 0.21-0.30, indicating better agreement with expert consensus. Performance variability decreased, narrowing the gap between early-career radiologists and experts.
CONCLUSION: ChatGPT-assisted reflective reasoning enhanced guideline alignment and reduced inappropriate procedural selections among early-career interventional radiologists. These findings support the role of large language models as cognitive support tools during early clinical practice and warrant prospective evaluation in real-world settings.
引用
- Yasar, Demir, Canturk, et al. Effect of ChatGPT-Assisted Reflective Reasoning on Guideline-Concordant Procedural Decision-Making Among Early-Career Interventional Radiologists. Acad Radiol. 2026. PMID: 41620349. doi:10.1016/j.acra.2026.01.017
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。