文献速递腹部泌尿生殖技术与安全CT

优化大语言模型用于腹部和盆腔CT扫描自动制定检查方案:上下文工程的作用

Optimizing Large Language Models for Automated Protocoling of Abdominal and Pelvic CT Scans: The Power of Context.
PubMed 文献 · Radiology · 2026-01-01

本回顾性研究纳入2024年1月至6月共1448例腹部或盆腔CT检查患者,评估GPT-4o在上下文工程与微调优化后自动分配检查方案的表现,并与放射科医生的实际选择比较。仅提示的GPT-4o选择最佳方案的比例高于人工选择(96.2% vs 88.3%,P < .001),微调未进一步提升表现;放射科医生、fellow和住院医师选择与参考标准一致的方案比例相似(79.4%、74.9%、72.1%,P = .30)。

要点

  • 仅提示的GPT-4o最佳方案比例96.2%,高于人工选择的88.3%(P < .001)。
  • 不适当方案比例仅提示组1.3%与人工组2.4%无证据差异(P = .21)。
  • 微调后最佳方案比例仍为96.2%,较仅提示无改善(P > .99)。

核心结论

  • 对于腹部和盆腔CT检查方案制定,经详细提示优化的GPT-4o选择最佳方案的频率高于放射科医生,模型微调未进一步提升表现。

研究设计与样本

  • 回顾性研究,纳入2024年1月至2024年6月腹部或盆腔CT检查患者1448例(平均年龄61岁±17[SD],女728例),以放射科医生结合机构指南定义的方案为参考标准。

诊断标准与关键数值

  • 由盲法放射科医生将模型选择方案与原人工选择方案对照参考标准分为完全匹配、等效替代、合理但较差、不适当;完全匹配与等效替代视为最佳。

临床应用与阅片要点

  • 模型选择方案与人工选择方案按上述四类与参考标准比较,由盲法放射科医生判读;研究中微调使用训练集和验证集,测试使用内部测试集。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Background Accurate protocoling is critical for imaging accuracy. Manual protocoling is time-consuming and error prone. Purpose To evaluate the performance of large language models (LLMs) in automatically assigning protocols for abdominal and pelvic CT scans after optimization with context engineering and fine-tuning and to compare performance with that of radiologists in practice. Materials and Methods This retrospective study included patients with abdominal or pelvic CT scans obtained between January 2024 and June 2024. Requisition data, human-selected protocol, and training level (resident, fellow, or radiologist) were extracted. Reference standard protocols were defined by radiologists in consultation with institutional guidelines. Context engineering involved detailed prompt instructions using a prompt set with GPT-4o (version 2024-08-06; Open AI). A subset of patients was reserved for fine-tuning (training set and validation set) and another for testing (internal test set). Two models were tested (prompting-only and fine-tuned). Model-selected protocols and original human-selected protocols were categorized compared with the reference standard after review by blinded radiologists as follows: exact match, equal alternative, reasonable but inferior, or inappropriate. Exact match and equal alternative were considered optimal. Performance of models and radiologists were compared using the McNemar test. Results This study included 1448 patients (mean age, 61 years ± 17 [SD]; 728 female patients). GPT-4o with prompting only selected optimal protocols more frequently than humans (96.2% [527 of 548 patients] vs 88.3% [484 of 548 patients]; P < .001), but there was no evidence of a difference in inappropriate protocols (1.3% [seven of 548 patients] vs 2.4% [13 of 548 patients]; P = .21). Fine-tuning GPT-4o did not improve the proportion of optimal protocols over prompting only (96.2% [527 of 548 patients] vs 96.2% [527 of 548 patients]; P > .99). In subgroup analyses, the proportion of protocols matching the reference standard was similar among radiologists (79.4% [173 of 218 patients]), fellows (74.9% [164 of 219 patients]), and residents (72.1% [80 of 111 patients]; P = .30). Conclusion For protocoling abdominal and pelvic CT scans, the LLM, GPT-4o, selected optimal protocols more frequently than radiologists when optimized with detailed prompting, and fine-tuning of the model did not further improve performance. © RSNA, 2026 Supplemental material is available for this article.

来源:Radiology,查看原文。版权归原作者所有。

引用

  1. Buckley BW, Dias AB, Deng Y, et al. Optimizing Large Language Models for Automated Protocoling of Abdominal and Pelvic CT Scans: The Power of Context. Radiology. 2026. PMID: 41493275. doi:10.1148/radiol.252105

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。