评估基于阳性发现的AI生成放射学报告的准确性和效率——放射学中AI的定性评估
本研究纳入100例复杂影像检查(MRI膝关节21例、MRI腰椎30例、CT头部23例、CT腹盆部26例),由顾问级肌骨放射科医师分别用传统口述和AI平台生成报告,比较报告时间、准确性、信心和整体体验。AI辅助使平均报告时间从6.1分钟降至3.43分钟(p<0.0001),准确性评分从3.81升至4.65(p<0.0001),信心评分从3.91升至4.67(p<0.0001),整体体验评分AI平台4.7 vs 传统方法3.69(p<0.0001)。AI报告存在轻微格式错误和偶发解剖误读,但可由放射科医师在审核时轻松纠正。
要点
- AI辅助使平均报告时间从6.1分钟降至3.43分钟(p<0.0001)。
- AI报告准确性评分从3.81升至4.65,医师信心评分从3.91升至4.67(均p<0.0001)。
- AI报告存在轻微格式错误和偶发解剖误读,需放射科医师审核纠正。
核心结论
- AI辅助报告平台显著提高了效率和放射科医师信心,且未损害准确性;但该工具仍需专家监督,尤其在解剖复杂的报告中。
研究设计与样本
- 本研究纳入100例影像病例,包括MRI膝关节(n=21)、MRI腰椎(n=30)、CT头部(n=23)和CT腹盆部(n=26);由顾问级肌骨放射科医师分别使用传统口述和AI平台报告每个病例;放射科医师先识别并输入关键阳性发现,AI系统据此生成完整报告草稿;记录报告时间,并以1-5分评估准确性、用户信心和整体报告体验;采用双尾t检验和95%置信区间进行统计分析。
诊断标准与关键数值
- AI辅助报告生成的平均报告时间为3.43分钟,传统口述为6.1分钟(p<0.0001)。
- AI辅助报告的准确性评分为4.65,传统口述为3.81(p<0.0001)。
- AI辅助报告的信心评分为4.67,传统口述为3.91(p<0.0001)。
- AI平台的整体报告体验评分为4.7,传统方法为3.69(p<0.0001)。
临床应用与阅片要点
- 放射科医师先识别并输入关键阳性发现,AI系统据此生成完整报告草稿。
- AI生成的报告存在轻微格式错误和偶发解剖误读,可由放射科医师在审核时轻松纠正。
- 作者认为该工具在提供关键临床发现时表现良好,但仍需专家监督,尤其在解剖复杂的报告中。
- 作者认为这些发现支持将AI作为放射学实践中的辅助工具,重点关注数据完整性、一致性和人工验证。
局限性
- AI生成的报告中观察到轻微格式错误和偶发解剖误读。
- 该工具在解剖复杂的报告中仍需专家监督。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
BACKGROUND: With increasing imaging demands, radiologists face growing workload pressures, often resulting in delays and reduced diagnostic efficiency. Recent advances in artificial intelligence (AI) have introduced tools for automated report generation, particularly in simpler imaging modalities, such as X-rays. However, limited research has assessed AI performance in complex studies such as MRI and CT scans, where report accuracy and clinical interpretation are critical.
OBJECTIVE: To evaluate the performance of a semi-automated AI-based reporting platform in generating radiology reports for complex imaging studies, and to compare its accuracy, efficiency, and user confidence with the traditional dictation method.
METHODOLOGY: This study involved 100 imaging cases, including MRI knee (n=21), MRI lumbar spine (n=30), CT head (n=23), and CT Abdomen and Pelvis (n=26). Consultant musculoskeletal radiologists reported each case using both traditional dictation and the AI platform. The radiologist first identified and entered the key positive findings, based on which the AI system generated a full draft report. Reporting time was recorded, and both methods were evaluated on accuracy, user confidence, and overall reporting experience (rated on a scale of 1-5). Statistical analysis was conducted using two-tailed t-tests and 95% confidence intervals.
RESULTS: AI-generated reports demonstrated significantly improved performance across all parameters. The mean reporting time reduced from 6.1 to 3.43 min (p<0.0001) with AI-assisted report generation. Accuracy improved from 3.81 to 4.65 (p<0.0001), confidence ratings increased from 3.91 to 4.67 (p<0.0001), and overall reporting experience favored using the AI platform for generating radiology reports (mean 4.7 vs. 3.69, p<0.0001). Minor formatting errors and occasional anatomical misinterpretations were observed in AI-generated reports, but could be easily corrected by the radiologist during review.
CONCLUSION: The AI-assisted reporting platform significantly improved efficiency and radiologist confidence without compromising accuracy. Although the tool performs well when provided with key clinical findings, it still requires expert oversight, especially in anatomically complex reporting. These findings support the use of AI as a supportive tool in radiology practice, with a focus on data integrity, consistency, and human validation.
引用
- Rajmohamed RF, Chapala S, Shazahan MA, et al. Evaluating the Accuracy and Efficiency of AI-Generated Radiology Reports Based on Positive Findings-A Qualitative Assessment of AI in Radiology. Acad Radiol. 2025. PMID: 41015710. doi:10.1016/j.acra.2025.09.012
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。