应用胸部X线摄影诊断2019冠状病毒病肺炎:人工智能的价值
这项回顾性研究开发并验证了深度学习算法CV19-Net,用于在胸部X线片上鉴别COVID-19肺炎与非COVID-19肺炎。测试集AUC为0.92,高敏感度阈值下敏感度88%、特异度79%,高特异度阈值下敏感度78%、特异度89%;在500例抽样测试集上AUC为0.94,高于三位经验丰富胸部放射科医师的0.85。
要点
- CV19-Net在测试集鉴别COVID-19肺炎与非COVID-19肺炎的AUC为0.92(95%CI: 0.91, 0.93)。
- 高敏感度阈值下敏感度88%、特异度79%;高特异度阈值下敏感度78%、特异度89%。
- 500例抽样测试集中CV19-Net的AUC为0.94,高于放射科医师的0.85。
诊断标准与关键数值
- 测试集CV19-Net的AUC为0.92(95%CI: 0.91, 0.93)。
- 高敏感度操作阈值下敏感度88%(95%CI: 87, 89)、特异度79%(95%CI: 77, 80)。
- 高特异度操作阈值下敏感度78%(95%CI: 77, 79)、特异度89%(95%CI: 88, 90)。
- 500例抽样测试集中CV19-Net的AUC为0.94(95%CI: 0.93, 0.96),放射科医师的AUC为0.85(95%CI: 0.81, 0.88)。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
Background Radiologists are proficient in differentiating between chest radiographs with and without symptoms of pneumonia but have found it more challenging to differentiate coronavirus disease 2019 (COVID-19) pneumonia from non-COVID-19 pneumonia on chest radiographs. Purpose To develop an artificial intelligence algorithm to differentiate COVID-19 pneumonia from other causes of abnormalities at chest radiography. Materials and Methods In this retrospective study, a deep neural network, CV19-Net, was trained, validated, and tested on chest radiographs in patients with and without COVID-19 pneumonia. For the chest radiographs positive for COVID-19, patients with reverse transcription polymerase chain reaction results positive for severe acute respiratory syndrome coronavirus 2 with findings positive for pneumonia between February 1, 2020, and May 30, 2020, were included. For the non-COVID-19 chest radiographs, patients with pneumonia who underwent chest radiography between October 1, 2019, and December 31, 2019, were included. Area under the receiver operating characteristic curve (AUC), sensitivity, and specificity were calculated to characterize diagnostic performance. To benchmark the performance of CV19-Net, a randomly sampled test data set composed of 500 chest radiographs in 500 patients was evaluated by the CV19-Net and three experienced thoracic radiologists. Results A total of 2060 patients (5806 chest radiographs; mean age, 62 years ± 16 [standard deviation]; 1059 men) with COVID-19 pneumonia and 3148 patients (5300 chest radiographs; mean age, 64 years ± 18; 1578 men) with non-COVID-19 pneumonia were included and split into training and validation and test data sets. For the test set, CV19-Net achieved an AUC of 0.92 (95% CI: 0.91, 0.93). This corresponded to a sensitivity of 88% (95% CI: 87, 89) and a specificity of 79% (95% CI: 77, 80) by using a high-sensitivity operating threshold, or a sensitivity of 78% (95% CI: 77, 79) and a specificity of 89% (95% CI: 88, 90) by using a high-specificity operating threshold. For the 500 sampled chest radiographs, CV19-Net achieved an AUC of 0.94 (95% CI: 0.93, 0.96) compared with an AUC of 0.85 (95% CI: 0.81, 0.88) achieved by radiologists. Conclusion CV19-Net was able to differentiate coronavirus disease 2019-related pneumonia from other types of pneumonia, with performance exceeding that of experienced thoracic radiologists. © RSNA, 2021 Online supplemental material is available for this article.
引用
- Zhang R, Tie X, Qi Z, et al. Diagnosis of Coronavirus Disease 2019 Pneumonia by Using Chest Radiography: Value of Artificial Intelligence. Radiology. 2020. PMID: 32969761. doi:10.1148/radiol.2020202944
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。