文献速递神经MR

基于MRI报告利用大语言模型预测成人型弥漫性胶质瘤的分子分型

Predicting molecular types of adult-type diffuse gliomas based on MRI reports with large language models.
PubMed 文献 · Eur Radiol · 2025-12-22

这项回顾性研究纳入亚洲和欧洲四家医院2005年7月至2024年3月诊断的2169例成人型弥漫性胶质瘤患者,评估七种大语言模型根据MRI报告预测2021年WHO分子分型的表现。提供胶质瘤影像知识后,多数模型准确率显著提高或相当,小模型差异更明显;神经肿瘤专科医师报告和高质量报告在各模型均显著提高准确率。

要点

  • 提供胶质瘤影像知识后,GPT-4o-mini、Qwen2.5 7B、Deepseek-r1 8B准确率显著提高,Llama 3.1 8B反而降低。
  • 神经肿瘤专科医师报告和高质量报告在所有大语言模型中均显著提高分类准确率。
  • 较大模型准确率通常更高且对领域知识依赖性较低。

核心结论

  • 大语言模型可能通过提示中提供相关知识,从MRI报告提供成人型弥漫性胶质瘤肿瘤类型的术前信息;信息丰富且描述性的报告可进一步提高模型表现。

研究设计与样本

  • 回顾性研究,纳入2005年7月至2024年3月亚洲和欧洲四家医院的2169例成人型弥漫性胶质瘤患者(294例少突胶质细胞瘤、295例IDH突变型星形细胞瘤、1580例IDH野生型胶质母细胞瘤)。评估GPT-4o-mini、GPT-4.1-mini、Llama 3.1 8B、Llama 3.1 70B、Qwen2.5 7B、Deepseek-r1 8B和Mistral 7B七种大语言模型,比较基于知识与朴素提示的分类表现,并评估神经肿瘤专科医师、报告质量和报告语言的影响。

诊断标准与关键数值

  • 基于知识提示与朴素提示的准确率比较:GPT-4o-mini 77.0% vs 79.1%(p<0.001);Qwen2.5 7B 75.9% vs 79.5%(p<0.001);Deepseek-r1 8B 66.0% vs 73.2%(p<0.001);GPT-4.1-mini 78.7% vs 78.6%;Llama 3.1 70B 78.0% vs 78.1%;Mistral 7B 58.4% vs 57.4%;Llama 3.1 8B 65.4% vs 44.6%(p<0.001)。

临床应用与阅片要点

  • 作者认为,大语言模型可能从MRI报告提供成人型弥漫性胶质瘤肿瘤类型的术前信息,信息丰富且描述性的报告可进一步提高其表现。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVES: To evaluate the performance of large language models (LLMs) in predicting molecular types of adult-type diffuse gliomas according to the 2021 WHO classification using MRI radiology reports.

MATERIALS AND METHODS: This retrospective study included 2169 patients diagnosed with adult-type diffuse gliomas (294 oligodendrogliomas, 295 IDH-mutant astrocytomas, and 1580 IDH-wildtype glioblastomas) between July 2005 and March 2024 from four hospitals in Asia and Europe. Seven proprietary and open-source LLMs were assessed: GPT-4o-mini, GPT-4.1-mini, Llama 3.1 8B, Llama 3.1 70B, Qwen2.5 7B, Deepseek-r1 8B, and Mistal 7B. The performance of LLMs in classifying molecular types was compared based on the provision of relevant knowledge of glioma imaging findings (knowledge-based vs. naïve prompt). The impact of radiologists' subspecialization in neuro-oncology, report quality, and reporting language on LLMs' performance was also evaluated.

RESULTS: LLMs achieved significantly higher (naïve vs. knowledge-based; GPT-4o-mini, 77.0% vs. 79.1%, p < 0.001; Qwen2.5 7B, 75.9% vs. 79.5%, p < 0.001; Deepseek-r1 8B, 66.0% vs. 73.2%, p < 0.001) or comparable accuracy (GPT-4.1-mini, 78.7% vs. 78.6%; Llama 3.1 70B, 78.0% vs. 78.1%; Mistral 7B, 58.4% vs. 57.4%) using knowledge-based prompt compared to naïve prompt, except for Llama 3.1 8B (65.4% vs. 44.6%, p < 0.001). Differences in accuracy were more pronounced in smaller-sized LLMs. Additionally, the accuracy was significantly higher with reports by neuro-oncology specialists and high-quality reports in all LLMs (p < 0.001).

CONCLUSIONS: LLMs may provide preoperative information on the tumor types of adult-type diffuse gliomas from MRI reports by providing relevant knowledge in the prompt. Informative and descriptive reports could further enhance LLMs' performance.

KEY POINTS: Question Our study aimed to evaluate large language models' (LLMs) ability to efficiently predict molecular types of adult-type diffuse gliomas according to the 2021 WHO classification. Findings Larger models generally showed better accuracy and were less sensitive to domain-specific knowledge. Their performance improved when using high-quality, longer reports or reports by neuro-oncology specialists. Clinical relevance These findings highlight the potential role of LLMs in predicting glioma molecular types, underscoring the importance of informative and descriptive reports in enhancing their performance.

来源:Eur Radiol,查看原文。版权归原作者所有。

引用

  1. Suh PS, Lee D, Bang CB, et al. Predicting molecular types of adult-type diffuse gliomas based on MRI reports with large language models. Eur Radiol. 2025. PMID: 41428044. doi:10.1007/s00330-025-12211-x

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。