生成式人工智能模型在胸部X线报告中的应用价值:一项阅片者研究
本回顾性、序贯、多阅片者多病例阅片者研究纳入758张2009至2017年公开数据集的胸部X线片,5名放射科医师分别在无和有AI生成报告作为初步报告两种条件下阅片。引入AI生成报告后平均阅片时间从34.2秒缩短至19.8秒,报告一致性评分与质量评分中位数均从5.0和4.5升至5.0,子集258张中纵隔增宽敏感度从84.3%升至90.8%、胸膜病变从77.7%升至87.4%。
要点
- AI生成报告使平均阅片时间从34.2秒降至19.8秒(P < .001)。
- 纵隔增宽敏感度从84.3%升至90.8%,胸膜病变从77.7%升至87.4%(P < .001)。
- 报告一致性与质量评分中位数均提高(P < .001),但阅片者间存在差异。
核心结论
- 使用领域特定的多模态生成式AI模型提高了放射学报告生成的效率和质量。
研究设计与样本
- 回顾性、序贯、多阅片者多病例阅片者研究,纳入758张2009至2017年公开数据集的胸部X线片,5名放射科医师分两阶段阅片,由2名经验丰富的胸部放射科医师评估,2023年10月至12月比较两阶段结果,采用广义线性混合模型分析。
诊断标准与关键数值
- 子集258张胸片评估报告事实正确性,纵隔增宽敏感度无AI报告84.3% vs 有AI报告90.8%(P < .001),胸膜病变敏感度无AI报告77.7% vs 有AI报告87.4%(P < .001),采用McNemar检验比较。
局限性
- 原文报告阅片者间存在个体差异。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Background Multimodal generative artificial intelligence (AI) technologies can produce preliminary radiology reports, and validation with reader studies is crucial for understanding the clinical value of these technologies. Purpose To assess the clinical value of the use of a domain-specific multimodal generative AI tool for chest radiograph interpretation by means of a reader study. Materials and Methods A retrospective, sequential, multireader, multicase reader study was conducted using 758 chest radiographs from a publicly available dataset from 2009 to 2017. Five radiologists interpreted the chest radiographs in two sessions: without AI-generated reports and with AI-generated reports as preliminary reports. Reading times, reporting agreement (RADPEER), and quality scores (five-point scale) were evaluated by two experienced thoracic radiologists and compared between the first and second sessions from October to December 2023. Reading times, report agreement, and quality scores were analyzed using a generalized linear mixed model. Additionally, a subset of 258 chest radiographs was used to assess the factual correctness of the reports, and sensitivities and specificities were compared between the reports from the first and second sessions with use of the McNemar test. Results The introduction of AI-generated reports significantly reduced average reading times from 34.2 seconds ± 20.4 to 19.8 seconds ± 12.5 (P < .001). Report agreement scores shifted from a median of 5.0 (IQR, 4.0-5.0) without AI reports to 5.0 (IQR, 4.5-5.0) with AI reports (P < .001). Report quality scores changed from 4.5 (IQR, 4.0-5.0) without AI reports to 4.5 (IQR, 4.5-5.0) with AI reports (P < .001). From the subset analysis of factual correctness, the sensitivity for detecting various abnormalities increased significantly, including widened mediastinal silhouettes (84.3% to 90.8%; P < .001) and pleural lesions (77.7% to 87.4%; P < .001). While the overall diagnostic performance improved, variability among individual radiologists was noted. Conclusion The use of a domain-specific multimodal generative AI model increased the efficiency and quality of radiology report generation. © RSNA, 2025 Supplemental material is available for this article. See also the editorial by Babyn and Adams in this issue.
引用
- Hong EK, Roh B, Park B, et al. Value of Using a Generative AI Model in Chest Radiography Reporting: A Reader Study. Radiology. 2025. PMID: 40067108. doi:10.1148/radiol.241646
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。