文献速递胸部技术与安全DR

DeepCOVID-XR:在大型美国临床数据集上训练和测试的用于检测胸部X线片COVID-19的人工智能算法

DeepCOVID-XR: An Artificial Intelligence Algorithm to Detect COVID-19 on Chest Radiographs Trained and Tested on a Large U.S. Clinical Data Set.
PubMed 文献 · Radiology · 2020-11-24

DeepCOVID-XR是一种深度学习人工智能算法,以逆转录聚合酶链反应结果为参考标准,在来自西北纪念医疗系统的14788张图像上训练和验证,并在单家留出机构的2214张图像上测试。在300张随机测试图像上,其准确率82%与五位放射科医师共识81%相似,AUC 0.88与共识0.85相比无显著差异(P=0.13)。

要点

  • DeepCOVID-XR在胸部X线片上检测COVID-19的准确率82%,与五位胸科放射科医师共识的81%相似。
  • 算法敏感度71%显著高于一位放射科医师的60%(P<0.001),特异度92%显著高于两位放射科医师的75%(P<0.001)和84%(P=0.009)。
  • 以共识判读为参考标准时,DeepCOVID-XR的AUC为0.95(95%CI:0.92,0.98)。

诊断标准与关键数值

  • 整个测试集:DeepCOVID-XR准确率83%,AUC 0.90。
  • 300张随机测试图像(134张COVID-19阳性):DeepCOVID-XR准确率82%,单个放射科医师准确率范围76%-81%,五位放射科医师共识准确率81%。
  • DeepCOVID-XR敏感度71%,显著高于一位放射科医师的60%(P<0.001)。
  • DeepCOVID-XR特异度92%,显著高于两位放射科医师的75%(P<0.001)和84%(P=0.009)。
  • DeepCOVID-XR的AUC为0.88,五位放射科医师共识AUC为0.85(比较P=0.13);以共识判读为参考标准时,DeepCOVID-XR的AUC为0.95(95%CI:0.92,0.98)。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Background There are characteristic findings of coronavirus disease 2019 (COVID-19) on chest images. An artificial intelligence (AI) algorithm to detect COVID-19 on chest radiographs might be useful for triage or infection control within a hospital setting, but prior reports have been limited by small data sets, poor data quality, or both. Purpose To present DeepCOVID-XR, a deep learning AI algorithm to detect COVID-19 on chest radiographs, that was trained and tested on a large clinical data set. Materials and Methods DeepCOVID-XR is an ensemble of convolutional neural networks developed to detect COVID-19 on frontal chest radiographs, with reverse-transcription polymerase chain reaction test results as the reference standard. The algorithm was trained and validated on 14 788 images (4253 positive for COVID-19) from sites across the Northwestern Memorial Health Care System from February 2020 to April 2020 and was then tested on 2214 images (1192 positive for COVID-19) from a single hold-out institution. Performance of the algorithm was compared with interpretations from five experienced thoracic radiologists on 300 random test images using the McNemar test for sensitivity and specificity and the DeLong test for the area under the receiver operating characteristic curve (AUC). Results A total of 5853 patients (mean age, 58 years ± 19 [standard deviation]; 3101 women) were evaluated across data sets. For the entire test set, accuracy of DeepCOVID-XR was 83%, with an AUC of 0.90. For 300 random test images (134 positive for COVID-19), accuracy of DeepCOVID-XR was 82%, compared with that of individual radiologists (range, 76%-81%) and the consensus of all five radiologists (81%). DeepCOVID-XR had a significantly higher sensitivity (71%) than one radiologist (60%, P < .001) and significantly higher specificity (92%) than two radiologists (75%, P < .001; 84%, P = .009). AUC of DeepCOVID-XR was 0.88 compared with the consensus AUC of 0.85 (P = .13 for comparison). With consensus interpretation as the reference standard, the AUC of DeepCOVID-XR was 0.95 (95% CI: 0.92, 0.98). Conclusion DeepCOVID-XR, an artificial intelligence algorithm, detected coronavirus disease 2019 on chest radiographs with a performance similar to that of experienced thoracic radiologists in consensus. © RSNA, 2020 Supplemental material is available for this article. See also the editorial by van Ginneken in this issue.

来源:Radiology,查看原文。版权归原作者所有。

引用

  1. Wehbe RM, Sheng J, Dutta S, et al. DeepCOVID-XR: An Artificial Intelligence Algorithm to Detect COVID-19 on Chest Radiographs Trained and Tested on a Large U.S. Clinical Data Set. Radiology. 2020. PMID: 33231531. doi:10.1148/radiol.2020203511

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。