文献速递胸部CT

深度神经网络提高临床医生在胸部CT上鉴别COVID-19与其他疑似病毒性肺炎的能力:一项真实世界研究

The usage of deep neural network improves distinguishing COVID-19 from other suspected viral pneumonia by clinicians on chest CT: a real-world study.
PubMed 文献 · Eur Radiol · 2020-12-28

该研究基于5家医院380例患者563次胸部CT训练深度学习模型,用于鉴别COVID-19肺炎与其他肺炎,并在2家医院316例患者318次CT的前瞻性真实世界数据中验证;模型在真实世界队列中AUC为0.868,敏感度0.811、特异度0.822,不劣于3名经验丰富放射科医生的表现。

要点

  • 模型在真实世界队列中鉴别COVID-19与非COVID-19肺炎的AUC为0.868(95%CI 0.851-0.876),敏感度0.811、特异度0.822。
  • 内部验证组诊断阈值为0.685时,敏感度0.836、特异度0.800、AUC 0.906(95%CI 0.886-0.913)。
  • 模型注意力热图无需额外人工标注即可生成,且注意力区域与放射科医生诊断所用ROI高度一致。

核心结论

  • 所建立的深度学习模型能在真实世界环境中准确鉴别COVID-19肺炎与其他疑似肺炎,可能成为临床常规中的可靠工具。

研究设计与样本

  • 研究为基于当前临床常规开发新型深度学习模型并用真实世界数据集验证的研究。
  • 训练集来自5家医院380例患者的563次胸部CT,其中227/380例诊断为COVID-19肺炎。
  • 采用U-net提取肺区域,经变换后输入预训练的基于ResNet-50的IDANNet产生诊断概率,并用五折交叉验证验证模型应用。
  • 真实世界数据集为来自另外2家医院的前瞻性入组316例患者的318次CT,其中243/316例诊断为COVID-19肺炎,用于检验模型性能并与3名经验丰富放射科医生的表现比较。

关键影像表现/征象

  • 模型注意力热图完全由模型生成且无需额外人工标注,注意力区域与放射科医生诊断所用ROI高度一致。

诊断标准与关键数值

  • 内部验证组中鉴别COVID-19与非COVID-19肺炎的诊断阈值为0.685,AUC为0.906(95%CI 0.886-0.913)。
  • 内部验证组阈值0.685时,敏感度为0.836、特异度为0.800。
  • 真实世界队列中模型AUC为0.868(95%CI 0.851-0.876),敏感度0.811、特异度0.822。

临床应用与阅片要点

  • 作者认为该模型在真实世界情况下能准确鉴别COVID-19肺炎与其他疑似肺炎,可能成为临床常规中的可靠工具。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVES: Based on the current clinical routine, we aimed to develop a novel deep learning model to distinguish coronavirus disease 2019 (COVID-19) pneumonia from other types of pneumonia and validate it with a real-world dataset (RWD).

METHODS: A total of 563 chest CT scans of 380 patients (227/380 were diagnosed with COVID-19 pneumonia) from 5 hospitals were collected to train our deep learning (DL) model. Lung regions were extracted by U-net, then transformed and fed to pre-trained ResNet-50-based IDANNet (Identification and Analysis of New covid-19 Net) to produce a diagnostic probability. Fivefold cross-validation was employed to validate the application of our model. Another 318 scans of 316 patients (243/316 were diagnosed with COVID-19 pneumonia) from 2 other hospitals were enrolled prospectively as the RWDs to testify our DL model's performance and compared it with that from 3 experienced radiologists.

RESULTS: A three-dimensional DL model was successfully established. The diagnostic threshold to differentiate COVID-19 and non-COVID-19 pneumonia was 0.685 with an AUC of 0.906 (95% CI: 0.886-0.913) in the internal validation group. In the RWD cohort, our model achieved an AUC of 0.868 (95% CI: 0.851-0.876) with the sensitivity of 0.811 and the specificity of 0.822, non-inferior to the performance of 3 experienced radiologists, suggesting promising clinical practical usage.

CONCLUSIONS: The established DL model was able to achieve accurate identification of COVID-19 pneumonia from other suspected ones in the real-world situation, which could become a reliable tool in clinical routine.

KEY POINTS: • In an internal validation set, our DL model achieved the best performance to differentiate COVID-19 from non-COVID-19 pneumonia with a sensitivity of 0.836, a specificity of 0.800, and an AUC of 0.906 (95% CI: 0.886-0.913) when the threshold was set at 0.685. • In the prospective RWD cohort, our DL diagnostic model achieved a sensitivity of 0.811, a specificity of 0.822, and AUC of 0.868 (95% CI: 0.851-0.876), non-inferior to the performance of 3 experienced radiologists. • The attention heatmaps were fully generated by the model without additional manual annotation and the attention regions were highly aligned with the ROIs acquired by human radiologists for diagnosis.

来源:Eur Radiol,查看原文。版权归原作者所有。

引用

  1. Xie Q, Lu Y, Xie X, et al. The usage of deep neural network improves distinguishing COVID-19 from other suspected viral pneumonia by clinicians on chest CT: a real-world study. Eur Radiol. 2020. PMID: 33372243. doi:10.1007/s00330-020-07553-7

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。