使用大语言模型解读不含BI-RADS的乳腺MRI报告:基于ChatGPT从叙述性报告自动进行BI-RADS分类
本回顾性单中心研究纳入2024年1月至2025年6月352份含可识别乳腺病灶描述性影像表现的乳腺MRI全文报告,评估ChatGPT(GPT-4o)在去除BI-RADS分类和临床建议后推断BI-RADS分类及建议临床处理步骤的能力。ChatGPT与放射科医生共识的BI-RADS分类一致性为中等(κ=0.510),良恶性二分类一致性几乎完美(κ=0.843),其处理建议与所赋BI-RADS分类100%一致。
要点
- ChatGPT对乳腺MRI叙述性报告的BI-RADS分类与医生共识为中等一致(κ=0.510)。
- 良恶性二分类一致性几乎完美(κ=0.843),良性报告正确率91.7%、恶性报告93.2%。
- 中间类别正确率较低:BI-RADS 3为52.4%、4B为29.4%,BI-RADS 5最高为77.9%。
核心结论
- ChatGPT能准确解读非结构化乳腺MRI报告,尤其在良恶性判别及相应临床建议方面;该技术有潜力作为决策支持工具以标准化报告和改善临床工作流程,尤其在报告实践不一的机构中。
研究设计与样本
- 回顾性、单中心研究,纳入2024年1月至2025年6月352份至少含一个可识别乳腺病灶且具描述性影像表现的乳腺MRI全文报告;由两名经验丰富的乳腺放射科医生实时评估并以共识作为参考标准;报告中原含「BI-RADS」者经人工去除BI-RADS分类和临床建议后,用两个标准化提示词经ChatGPT处理。
诊断标准与关键数值
- BI-RADS分类一致性Cohen's Kappa为0.510(p<0.001);BI-RADS 5正确率77.9%、BI-RADS 3正确率52.4%、BI-RADS 4B正确率29.4%;良恶性二分类Kappa为0.843,良性报告正确率91.7%、恶性报告正确率93.2%。
临床应用与阅片要点
- 作者认为该技术有潜力作为决策支持工具以标准化报告和改善临床工作流程,尤其在报告实践不一的机构中;模型的处理建议与所赋BI-RADS分类100%一致,对全部BI-RADS 4-5病例建议活检,对BI-RADS 3报告建议短期随访或条件性活检。
局限性
- 原文结论指出需要前瞻性、多机构研究进一步验证。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: This study aimed to evaluate the performance of ChatGPT (GPT-4o) in interpreting free-text breast magnetic resonance imaging (MRI) reports by assigning BI-RADS categories and recommending appropriate clinical management steps in the absence of explicitly stated BI-RADS classifications.
METHODS: In this retrospective, single-center study, a total of 352 documented full-text breast MRI reports of at least one identifiable breast lesion with descriptive imaging findings between January 2024 and June 2025 were included in the study. Incomplete reports due to technical limitations, reports describing only normal findings, and MRI examinations performed at external institutions were excluded from the study. First, it was aimed to assess ChatGPT's ability to infer the correct BI-RADS category (2-3-4a-4b-4c-5 separately) based solely on the narrative imaging findings. Second, it was evaluated the model's ability to distinguish between benign versus suspicious/malignant imaging features in terms of clinical decision-making. Therefore, BI-RADS 2-3 categories were grouped as "benign," and BI-RADS 4-5 as "suspicious/malignant," in alignment with how BI-RADS categories are used to guide patient management, rather than to represent definitive diagnostic outcomes. Reports originally containing the term "BI-RADS" were manually de-identified by removing BI-RADS categories and clinical recommendations. Each narrative report was then processed through ChatGPT using two standardized prompts as follows: (1) What is the most appropriate BI-RADS category based on the findings in the report? (2) What should be the next clinical step (e.g., follow-up, biopsy)? Responses were evaluated in real time by two experienced breast radiologists, and consensus was used as the reference standard.
RESULTS: ChatGPT demonstrated moderate agreement with radiologists' consensus for BI-RADS classification (Cohen's Kappa (κ): 0.510, p<0.001). Classification accuracy was highest for BI-RADS 5 reports (77.9%), whereas lower agreement was observed in intermediate categories such as BI-RADS 3 (52.4% correct) and 4B (29.4% correct). In the binary classification of reports as benign or malignant, ChatGPT achieved almost perfect agreement (κ: 0.843), correctly identifying 91.7% of benign and 93.2% of malignant reports. Notably, the model's management recommendations were 100% consistent with its assigned BI-RADS categories, advising biopsy for all BI-RADS 4-5 cases and short-interval follow-up or conditional biopsy for BI-RADS 3 reports.
CONCLUSION: ChatGPT accurately interprets unstructured breast MRI reports, particularly in benign/malignant discrimination and corresponding clinical recommendations. This technology holds potential as a decision support tool to standardize reporting and enhance clinical workflows, especially in settings with variable reporting practices. Prospective, multi-institutional studies are needed for further validation.
引用
- Tekcan Sanli DE, Sanli AN, Ozmen G, et al. Interpreting BI-RADS-Free Breast MRI Reports Using a Large Language Model: Automated BI-RADS Classification From Narrative Reports Using ChatGPT. Acad Radiol. 2025. PMID: 40915935. doi:10.1016/j.acra.2025.08.026
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。