文献速递胸部DRCT

基于人工智能的胸部X线肺癌检测改善:NLST数据集多阅片者研究结果

AI-based improvement in lung cancer detection on chest radiographs: results of a multi-reader study in NLST dataset.
PubMed 文献 · Eur Radiol · 2021-06-04

该阅片者研究纳入NLST数据集中癌症阳性患者173幅图像和癌症阴性患者346幅图像,8名阅片者(3名放射科住院医师和5名委员会认证放射科医师)在有无AI辅助下检测肺癌。AI作为第二阅片者时,住院医师敏感度提高、放射科医师假阳性减少,放射科医师对癌症阴性患者不必要的胸部CT推荐减少。

要点

  • AI辅助使住院医师对可见肺癌的敏感度从0.61提高至0.72(p=0.016),放射科医师敏感度无显著变化(0.76 vs 0.76,p=1.00)。
  • AI辅助使放射科医师每幅图像假阳性数从0.24降至0.17(p<0.001),住院医师无显著变化(0.15 vs 0.12,p=0.13)。
  • AI辅助使放射科医师对癌症阴性患者的胸部CT推荐率从16.4%降至11.7%(p<0.001),住院医师无显著变化(11.2% vs 9.8%,p=0.32)。

核心结论

  • AI算法作为第二阅片者使用时,可提高阅片者在胸部X线上检测肺癌的表现:住院医师获得敏感度获益,放射科医师获得特异度获益。

研究设计与样本

  • 阅片者研究,纳入NLST数据集中癌症阳性患者(n=98)的173幅图像和癌症阴性患者(n=196)的346幅图像,8名阅片者包括3名放射科住院医师和5名委员会认证放射科医师,AI算法提供图像级肺结节或肿块概率及检测病灶热图,参考标准为NLST数据集中的肺癌诊断。

诊断标准与关键数值

  • 住院医师无AI敏感度0.61(95%CI 0.55-0.67)vs 有AI 0.72(95%CI 0.66-0.77),p=0.016。
  • 放射科医师无AI敏感度0.76(95%CI 0.72-0.81)vs 有AI 0.76(95%CI 0.72-0.81),p=1.00。
  • 住院医师无AI假阳性每图像0.15(95%CI 0.11-0.18)vs 有AI 0.12(95%CI 0.09-0.16),p=0.13。
  • 放射科医师无AI假阳性每图像0.24(95%CI 0.20-0.29)vs 有AI 0.17(95%CI 0.13-0.20),p<0.001。
  • 住院医师对癌症阳性患者胸部CT推荐率无AI 54.7%(95%CI 48.2-61.2%)vs 有AI 70.2%(95%CI 64.2-76.2%),p<0.001。

临床应用与阅片要点

  • AI算法可作为第二阅片者用于胸部X线肺癌检测,住院医师可借此提高对可见肺癌的敏感度。
  • 放射科医师使用AI辅助可减少假阳性发现及对癌症阴性患者不必要的胸部CT推荐。
  • AI辅助对住院医师和放射科医师的获益模式不同:住院医师敏感度提高,放射科医师特异度提高。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVE: Assess if deep learning-based artificial intelligence (AI) algorithm improves reader performance for lung cancer detection on chest X-rays (CXRs).

METHODS: This reader study included 173 images from cancer-positive patients (n = 98) and 346 images from cancer-negative patients (n = 196) selected from National Lung Screening Trial (NLST). Eight readers, including three radiology residents, and five board-certified radiologists, participated in the observer performance test. AI algorithm provided image-level probability of pulmonary nodule or mass on CXRs and a heatmap of detected lesions. Reader performance was compared with AUC, sensitivity, specificity, false-positives per image (FPPI), and rates of chest CT recommendations.

RESULTS: With AI, the average sensitivity of readers for the detection of visible lung cancer increased for residents, but was similar for radiologists compared to that without AI (0.61 [95% CI, 0.55-0.67] vs. 0.72 [95% CI, 0.66-0.77], p = 0.016 for residents, and 0.76 [95% CI, 0.72-0.81] vs. 0.76 [95% CI, 0.72-0.81, p = 1.00 for radiologists), while false-positive findings per image (FPPI) was similar for residents, but decreased for radiologists (0.15 [95% CI, 0.11-0.18] vs. 0.12 [95% CI, 0.09-0.16], p = 0.13 for residents, and 0.24 [95% CI, 0.20-0.29] vs. 0.17 [95% CI, 0.13-0.20], p < 0.001 for radiologists). With AI, the average rate of chest CT recommendation in patients positive for visible cancer increased for residents, but was similar for radiologists (54.7% [95% CI, 48.2-61.2%] vs. 70.2% [95% CI, 64.2-76.2%], p < 0.001 for residents and 72.5% [95% CI, 68.0-77.1%] vs. 73.9% [95% CI, 69.4-78.3%], p = 0.68 for radiologists), while that in cancer-negative patients was similar for residents, but decreased for radiologists (11.2% [95% CI, 9.6-13.1%] vs. 9.8% [95% CI, 8.0-11.6%], p = 0.32 for residents and 16.4% [95% CI, 14.7-18.2%] vs. 11.7% [95% CI, 10.2-13.3%], p < 0.001 for radiologists).

CONCLUSIONS: AI algorithm can enhance the performance of readers for the detection of lung cancers on chest radiographs when used as second reader.

KEY POINTS: • Reader study in the NLST dataset shows that AI algorithm had sensitivity benefit for residents and specificity benefit for radiologists for the detection of visible lung cancer. • With AI, radiology residents were able to recommend more chest CT examinations (54.7% vs 70.2%, p < 0.001) for patients with visible lung cancer. • With AI, radiologists recommended significantly less proportion of unnecessary chest CT examinations (16.4% vs. 11.7%, p < 0.001) in cancer-negative patients.

来源:Eur Radiol,查看原文。版权归原作者所有。

引用

  1. Yoo H, Lee SH, Arru CD, et al. AI-based improvement in lung cancer detection on chest radiographs: results of a multi-reader study in NLST dataset. Eur Radiol. 2021. PMID: 34089072. doi:10.1007/s00330-021-08074-7

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。