文献速递神经技术与安全MR

在需要最少时表现最佳:读者经验影响大语言模型辅助脑MRI鉴别诊断的准确率增益

Performing Best When Needed Least: Reader Experience Shapes Accuracy Gains in Large Language Model-assisted Brain MRI Differential Diagnosis.
PubMed 文献 · Radiology · 2026-01-01

结果显示,随着读者经验增加,LLM基于其输入生成的诊断准确率提高,但LLM辅助带来的绝对准确率增益反而减小(神经内科/外科住院医师+19.4%,放射科住院医师+14.7%,神经放射科医师+4.4%)。

要点

  • LLM辅助的绝对增益在经验最少的读者中最大,经验丰富者增益最小。
  • 读者经验与LLM辅助诊断增益呈负相关(β=-0.10,P=.005)。
  • 读者经验与影像所见正确性(β=0.11,P<.001)和完整性(β=0.18,P=.002)正相关。

局限性

  • 仅评估文本影像所见驱动的LLM,未涉及直接图像输入。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Background Studies have demonstrated that large language models (LLMs) can perform differential diagnosis based on textual radiologic findings; however, it is unclear how variations in reader-generated inputs affect LLM performance and clinical utility. Purpose To evaluate how reader experience influences the diagnostic benefit of LLM assistance in brain MRI differential diagnosis. Materials and Methods In this retrospective multireader study, neuroradiologists (n = 4), radiology residents (n = 4), and neurology/neurosurgery residents (n = 4) provided textual radiologic findings and their top three differential diagnoses for brain MRI scans with confirmed diagnoses obtained between January 2009 and April 2024 from a single academic center. Confirmed diagnoses were established histopathologically or through consensus of at least two neuroradiologists. Three LLMs (GPT-4.1 [OpenAI], Gemini 2.5 Pro [Google DeepMind], and DeepSeek-R1 [Hangzhou DeepSeek Artificial Intelligence Basic Technology Research]) generated differential diagnoses based on reader-provided findings. Readers revised their diagnoses after reviewing the suggestions of GPT-4.1. A cumulative link mixed model was fitted to evaluate the association between reader experience and diagnostic benefit, with change in diagnostic result as an ordinal outcome, reader experience as a predictor, and random intercepts for rater and patient. Results Forty brain MRI scans (mean patient age, 50 years ± 18 [SD]; 23 female) were included. LLM-generated diagnoses achieved the highest top-three accuracy based on imaging findings from neuroradiologists (78.8%-83.8% across LLMs), followed by radiology residents (71.8%-77.6%) and neurology/neurosurgery residents (63.2%-67.1%). Mean absolute gains in top-three accuracy with LLM assistance diminished with increasing experience: +19.4% for neurology/neurosurgery residents (from 43.2% to 62.6%), +14.7% for radiology residents (from 59.6% to 74.4%), and +4.4% for neuroradiologists (from 83.1% to 87.5%). Models demonstrated a negative association between reader experience and diagnostic benefit from LLM assistance (β = -0.10; P = .005) and a positive association of reader experience with correctness (β = 0.11; P < .001) and completeness (β = 0.18; P = .002) of imaging findings. Conclusion With increasing reader experience, LLM accuracy with reader-generated input improved, whereas accuracy gains from LLM assistance diminished. © RSNA, 2026 Supplemental material is available for this article. See also the editorial by McMillan in this issue.

来源:Radiology,查看原文。版权归原作者所有。

引用

  1. Schramm S, Le Guellec B, Topka M, et al. Performing Best When Needed Least: Reader Experience Shapes Accuracy Gains in Large Language Model-assisted Brain MRI Differential Diagnosis. Radiology. 2026. PMID: 42188726. doi:10.1148/radiol.253477

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。