文献速递胸部技术与安全DR

胸部X线片上的COVID-19:人工智能系统的多读者评估

COVID-19 on Chest Radiographs: A Multireader Evaluation of an Artificial Intelligence System.
PubMed 文献 · Radiology · 2020-05-08

该研究在一家中心连续纳入454例疑似COVID-19肺炎患者的胸部X线片,以RT-PCR为参考标准,评估人工智能系统(CAD4COVID-XRay)的诊断性能。AI系统检测COVID-19肺炎的AUC为0.81,在最高敏感度下显著优于每位读者(P < .001),在最低敏感度下仅一位读者显著优于AI系统(P = .04)。结论认为AI系统性能与六位独立读者相当。

要点

  • AI系统检测COVID-19肺炎的AUC为0.81,以RT-PCR为参考标准。
  • 在最高敏感度下,AI系统显著优于每位读者(P < .001,McNemar检验)。
  • 在最低敏感度下,仅一位读者显著优于AI系统(P = .04)。

核心结论

  • 人工智能系统在胸部X线片上检测COVID-19的性能与六位独立读者相当。

研究设计与样本

  • 研究为多读者评估,测试集为一家中心2020年3月4日至4月6日连续采集的疑似COVID-19肺炎患者胸部X线片454例(RT-PCR阳性223例,阴性231例)。
  • AI系统(CAD4COVID-XRay)在24678张胸部X线片上训练,其中1540张仅用于训练中的验证。
  • 胸部X线片由六位读者和AI系统独立分析,以RT-PCR结果为参考标准,采用受试者工作特征曲线分析诊断性能。
  • 测试集患者平均年龄67岁±14.4(标准差),男性占56%。

诊断标准与关键数值

  • 以RT-PCR为参考标准,AI系统正确分类COVID-19肺炎的受试者工作特征曲线下面积为0.81。
  • 在最高敏感度下,AI系统显著优于每位读者(P < .001,McNemar检验)。
  • 在最低敏感度下,仅一位读者显著优于AI系统(P = .04)。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Background Chest radiography may play an important role in triage for coronavirus disease 2019 (COVID-19), particularly in low-resource settings. Purpose To evaluate the performance of an artificial intelligence (AI) system for detection of COVID-19 pneumonia on chest radiographs. Materials and Methods An AI system (CAD4COVID-XRay) was trained on 24 678 chest radiographs, including 1540 used only for validation while training. The test set consisted of a set of continuously acquired chest radiographs (n = 454) obtained in patients suspected of having COVID-19 pneumonia between March 4 and April 6, 2020, at one center (223 patients with positive reverse transcription polymerase chain reaction [RT-PCR] results, 231 with negative RT-PCR results). Radiographs were independently analyzed by six readers and by the AI system. Diagnostic performance was analyzed with the receiver operating characteristic curve. Results For the test set, the mean age of patients was 67 years ± 14.4 (standard deviation) (56% male). With RT-PCR test results as the reference standard, the AI system correctly classified chest radiographs as COVID-19 pneumonia with an area under the receiver operating characteristic curve of 0.81. The system significantly outperformed each reader (P < .001 using the McNemar test) at their highest possible sensitivities. At their lowest sensitivities, only one reader significantly outperformed the AI system (P = .04). Conclusion The performance of an artificial intelligence system in the detection of coronavirus disease 2019 on chest radiographs was comparable with that of six independent readers. © RSNA, 2020.

来源:Radiology,查看原文。版权归原作者所有。

引用

  1. Murphy K, Smits H, Knoops AJG, et al. COVID-19 on Chest Radiographs: A Multireader Evaluation of an Artificial Intelligence System. Radiology. 2020. PMID: 32384019. doi:10.1148/radiol.2020201874

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。