文献速递胸部DR

生成式人工智能模型用于胸片报告生成的临床验证:一项多队列研究

Clinical Validation of a Generative Artificial Intelligence Model for Chest Radiograph Reporting: A Multicohort Study.
PubMed 文献 · Radiology · 2025-01-01

本研究回顾性收集2020年1月至2022年12月ICU、急诊和健康体检的胸片及公共数据集门诊胸片,应用自动报告生成AI算法,由7名胸部放射科医师评估报告可接受性。AI报告与放射科医师报告在标准标准下可接受性无显著差异(88.4% vs 89.2%;P = .36),但严格标准下较低(66.8% vs 75.7%;P < .001);AI报告识别可转诊异常的敏感度更高(81.2% vs 59.4%)而特异度更低(81.0% vs 93.6%),多数放射科医师认为AI报告尚不足以替代医师报告。

要点

  • AI生成胸片报告在标准可接受性上与放射科医师报告无显著差异,但严格标准下较低。
  • AI报告识别可转诊异常的敏感度更高但特异度更低,阅片时需注意假阳性。
  • 多数放射科医师认为AI报告尚不足以替代放射科医师撰写的报告。

核心结论

  • AI生成的胸片报告与放射科医师报告可接受性相似,但相当比例的AI报告需要小幅修改;AI报告敏感度更高而特异度更低;多数放射科医师认为AI报告尚不足以替代医师报告。

研究设计与样本

  • 多队列研究,回顾性收集2020年1月至2022年12月ICU、急诊和健康体检的胸片及公共数据集门诊胸片,共纳入1539例(中位年龄55岁;656例男性、483例女性、400例性别未知),应用自动报告生成AI算法,由7名胸部放射科医师组成的小组评估报告可接受性。

诊断标准与关键数值

  • 标准标准(可接受无需修改或仅需小幅修改)下AI报告与放射科医师报告可接受性分别为88.4% vs 89.2%(P = .36);严格标准(可接受无需修改)下分别为66.8% vs 75.7%(P < .001);AI报告与放射科医师报告识别可转诊异常的敏感度分别为81.2% vs 59.4%(P < .001),特异度分别为81.0% vs 93.6%(P < .001)。

临床应用与阅片要点

  • 作者结论指出AI生成胸片报告与放射科医师报告可接受性相似但相当比例需小幅修改;调查中多数放射科医师认为AI报告尚不足以替代医师报告。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Background Artificial intelligence (AI)-generated radiology reports have become available and require rigorous evaluation. Purpose To evaluate the clinical acceptability of chest radiograph reports generated by an AI algorithm and their accuracy in identifying referable abnormalities. Materials and Methods Chest radiographs from an intensive care unit (ICU), an emergency department, and health checkups were retrospectively collected between January 2020 and December 2022, and outpatient chest radiographs were sourced from a public dataset. An automated report-generating AI algorithm was then applied. A panel of seven thoracic radiologists evaluated the acceptability of generated reports, and acceptability was analyzed using a standard criterion (acceptable without revision or with minor revision) and a stringent criterion (acceptable without revision). Using chest radiographs from three of the contexts (excluding the ICU), AI-generated and radiologist-written reports were compared regarding the acceptability of the reports (generalized linear mixed model) and their sensitivity and specificity for identifying referable abnormalities (McNemar test). The radiologist panel was surveyed to evaluate their perspectives on the potential of AI-generated reports to replace radiologist-written reports. Results The chest radiographs of 1539 individuals (median age, 55 years; 656 male patients, 483 female patients, 400 patients of unknown sex) were included. There was no evidence of a difference in acceptability between AI-generated and radiologist-written reports under the standard criterion (88.4% vs 89.2%; P = .36), but AI-generated reports were less acceptable than radiologist-written reports under the stringent criterion (66.8% vs 75.7%; P < .001). Compared with radiologist-written reports, AI-generated reports identified radiographs with referable abnormalities with greater sensitivity (81.2% vs 59.4%; P < .001) and lower specificity (81.0% vs 93.6%; P < .001). In the survey, most radiologists indicated that AI-generated reports were not yet reliable enough to replace radiologist-written reports. Conclusion AI-generated chest radiograph reports had similar acceptability to radiologist-written reports, although a substantial proportion of AI-generated reports required minor revision. © RSNA, 2025 Supplemental material is available for this article. See also the editorial by Wu and Seo in this issue.

来源:Radiology,查看原文。版权归原作者所有。

引用

  1. Hwang EJ, Lee JH, Lim WH, et al. Clinical Validation of a Generative Artificial Intelligence Model for Chest Radiograph Reporting: A Multicohort Study. Radiology. 2025. PMID: 40985833. doi:10.1148/radiol.250568

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。