文献速递胸部技术与安全DRCT

人工智能作为第二读者对放射科医生和非放射科医生在胸部X线片上肺结节检出与定位准确性的影响:一项多中心读者研究

Effect of Artificial Intelligence as a Second Reader on the Lung Nodule Detection and Localization Accuracy of Radiologists and Non-radiology Physicians in Chest Radiographs: A Multicenter Reader Study.
PubMed 文献 · Acad Radiol · 2024-11-25

这项多中心多读者多病例回顾性研究纳入300张胸部X线片,15名读者(9名放射科医生和6名非放射科医生)在无AI和有AI辅助下各读片一次。AI辅助后平均AFROC从0.73升至0.81,病例水平敏感度从72.8%升至83.5%,特异度无显著差异。结论为使用AI可检出并定位更多结节,假阳性无显著增加。

要点

  • AI辅助后读者平均AFROC从0.73升至0.81,95%CI差值0.05-0.10。
  • AI辅助后病例水平敏感度从72.8%升至83.5%,95%CI差值6.8-14.6。
  • AI辅助后特异度71.1%升至72.0%,95%CI差值-0.8-2.6,无显著差异。

核心结论

  • 使用AI作为第二读者,读者检出并定位了更多肺结节,假阳性判读无显著差异。

研究设计与样本

  • 回顾性多读者多病例研究,纳入美国40家医院的300张胸部X线片(147张有结节、153张无结节),以5名独立胸部放射科医生结合配对随访图像(胸部CT或胸部X线片)建立的结节存在与位置为参考标准;15名读者(9名放射科医生、6名非放射科医生)在无AI和有AI辅助下各读片一次。

诊断标准与关键数值

  • 主要分析为无AI与有AI辅助下读者平均AFROC的差异:0.73 vs 0.81(95%CI差值0.05-0.10);病例水平AUROC:0.77 vs 0.84(95%CI差值0.04-0.09);病例水平敏感度72.8% vs 83.5%(95%CI差值6.8-14.6);特异度71.1% vs 72.0%(95%CI差值-0.8-2.6)。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

RATIONALE AND OBJECTIVES: Missed nodules in chest radiographs (CXRs) are common occurrences. We assessed the effect of artificial intelligence (AI) as a second reader on the accuracy of radiologists and non-radiology physicians in lung nodule detection and localization in CXRs.

MATERIALS AND METHODS: This retrospective study using the multi-reader multi-case design included 300 CXRs acquired from 40 hospitals across the US. All CXRs had a paired follow-up image (chest CT or CXR) to augment the ground truth establishment for the presence and location of nodules on CXRs by five independent thoracic radiologists. 15 readers (nine radiologists and six non-radiology physicians) read each CXR twice in a second-reader paradigm, once without AI and then immediately with AI assistance. The primary analysis assessed the difference in area-under-the-alternative-free-response-receiver-operating-characteristic-curve (AFROC) of readers with and without AI. Case-level area-under-the-receiver-operating-characteristic-curve (AUROC), sensitivity, and specificity were assessed in secondary analyses.

RESULTS: A total of 300 CXRs (147 with nodules, 153 without nodules) from 300 patients (mean age, 64 years ± 15 [standard deviation]; 174 women) were included. The mean AFROC of readers was 0.73 without AI and 0.81 with AI (95% CI of difference, 0.05-0.10). Case-level AUROC was 0.77 without AI and 0.84 with AI (95% CI of difference, 0.04-0.09). Case-level sensitivity was 72.8% and 83.5% (95% CI of difference, 6.8-14.6) and specificity was 71.1% and 72.0% (95% CI of difference, -0.8-2.6) without and with AI, respectively.

CONCLUSION: Using AI, readers detected and localized more nodules without any significant difference in false positive interpretations.

来源:Acad Radiol,查看原文。版权归原作者所有。

引用

  1. Robert D, Sathyamurthy S, Singh AK, et al. Effect of Artificial Intelligence as a Second Reader on the Lung Nodule Detection and Localization Accuracy of Radiologists and Non-radiology Physicians in Chest Radiographs: A Multicenter Reader Study. Acad Radiol. 2024. PMID: 39592384. doi:10.1016/j.acra.2024.11.003

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。