文献速递腹部技术与安全CT

评估ChatGPT作为影像检查转诊工具的可靠性:与临床决策支持系统的比较研究

Evaluating the reliability of ChatGPT as a tool for imaging test referral: a comparative study with a clinical decision support system.
PubMed 文献 · Eur Radiol · 2023-10-13

在某三级医院连续纳入97例因腹部症状急诊就诊的病例,比较ChatGPT与ESR iGuide推荐的影像检查转诊建议,并对ChatGPT推荐胸腹盆腔CT的66例由四名专家评分。ChatGPT建议与ESR iGuide一致,CAP亚组分析中与专家高度一致,12.4%的不一致病例呈现模糊推荐措辞;作者认为ChatGPT引导选择合适检查的能力可能与ESR iGuide在某种程度上相当,但临床实施前仍需解决临床、伦理和监管问题,需进一步研究证实。

要点

  • ChatGPT的影像检查转诊建议与ESR iGuide高度一致。
  • 在ChatGPT推荐胸腹盆腔CT的病例中,其与专家评分高度一致。
  • 12.4%的不一致病例中,ChatGPT给出模糊推荐措辞。

核心结论

  • ChatGPT引导选择合适检查的能力可能与ESR iGuide在某种程度上相当。
  • 临床实施前仍需解决临床、伦理和监管问题,需进一步研究证实这些发现。

研究设计与样本

  • 在三级医院开展的比较研究,连续纳入97例因腹部症状急诊就诊的病例。
  • 比较ESR iGuide与ChatGPT推荐的影像检查转诊建议,并分析不一致病例。
  • 选取ChatGPT推荐胸腹盆腔CT的病例(n=66),由四名专家对转诊适当性进行评分。

诊断标准与关键数值

  • ChatGPT推荐与ESR iGuide推荐一致,按年龄或性别分层的转诊适当性无统计学差异。
  • 胸腹盆腔CT亚组分析显示ChatGPT与专家评分高度一致。
  • 不一致病例占12.4%,呈现「it would be advisable」和「this would help to rule out」等模糊推荐措辞。

临床应用与阅片要点

  • 原文未据此给出推荐。

局限性

  • 临床、伦理和监管影响仍需解决,临床实施前需要处理。
  • 需进一步研究证实这些发现。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVES: As the technology continues to evolve and advance, we can expect to see artificial intelligence (AI) being used in increasingly sophisticated ways to make a diagnosis and decisions such as suggesting the most appropriate imaging referrals. We aim to explore whether Chat Generative Pretrained Transformer (ChatGPT) can provide accurate imaging referrals for clinical use that are at least as good as the ESR iGuide.

METHODS: A comparative study was conducted in a tertiary hospital. Data was collected from 97 consecutive cases that were admitted to the emergency department with abdominal complaints. We compared the imaging test referral recommendations suggested by the ESR iGuide and the ChatGPT and analyzed cases of disagreement. In addition, we selected cases where ChatGPT recommended a chest abdominal pelvis (CAP) CT (n = 66), and asked four specialists to grade the appropriateness of the referral.

RESULTS: ChatGPT recommendations were consistent with the recommendations provided by the ESR iGuide. No statistical differences were found between the appropriateness of referrals by age or gender. Using a sub-analysis of CAP cases, a high agreement between ChatGPT and the specialists was found. Cases of disagreement (12.4%) were further analyzed and presented themes of vague recommendations such as "it would be advisable" and "this would help to rule out."

CONCLUSIONS: ChatGPT's ability to guide the selection of appropriate tests may be comparable to some degree with the ESR iGuide. Features such as the clinical, ethical, and regulatory implications are still warranted and need to be addressed prior to clinical implementation. Further studies are needed to confirm these findings.

CLINICAL RELEVANCE STATEMENT: The article explores the potential of using advanced language models, such as ChatGPT, in healthcare as a CDS for selecting appropriate imaging tests. Using ChatGPT can improve the efficiency of the decision-making process KEY POINTS: • ChatGPT recommendations were highly consistent with the recommendations provided by the ESR iGuide. • ChatGPT's ability in guiding the selection of appropriate tests may be comparable to some degree with ESR iGuide's.

来源:Eur Radiol,查看原文。版权归原作者所有。

引用

  1. Rosen S, Saban M. Evaluating the reliability of ChatGPT as a tool for imaging test referral: a comparative study with a clinical decision support system. Eur Radiol. 2023. PMID: 37828297. doi:10.1007/s00330-023-10230-0

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。