人工智能辅助的COVID-19胸部X线评估方案
本研究为双向性临床研究,将487例患者的胸部X线按2名放射科医师共识分为正常、典型COVID、不确定和非COVID四类,再对判为正常和不确定的影像用训练过的卷积神经网络分析,并与RT-PCR金标准比较。结果显示,有AI辅助时放射科医师的精确率从65.9%升至81.9%,召回率从17.5升至71.75,AI对正常胸片分类COVID或非COVID的准确率为92%。
要点
- AI辅助可提高放射科医师判读胸片判断COVID状态的召回率(17.5升至71.75)和精确率(65.9%升至81.9%)。
- AI在放射科医师判为正常的胸片上达到92%的COVID/非COVID分类准确率,注意力图提示关注心影。
- AI注意力图提示可能存在肉眼不可见的细微心脏改变,为后续研究提供方向。
核心结论
- 部署AI算法可补充人类专家判断COVID状态;AI在判为正常的胸片上表现最佳,注意力图提示可能的细微心脏改变,为后续研究奠定基础。
研究设计与样本
- 双向性临床研究,纳入487例患者的胸部X线,由2名放射科医师共识分为正常、典型COVID、不确定和非COVID四类,参考标准为RT-PCR,使用训练过的卷积神经网络。
关键影像表现/征象
- AI注意力图分析显示,在判为正常的胸片上注意力集中于心影。
- AI注意力图提示可能存在肉眼不可见的细微心脏改变。
诊断标准与关键数值
- 放射科医师单独判读的精确率为65.9%,召回率为17.5。
- 放射科医师在AI辅助下的精确率为81.9%,召回率为71.75。
- AI对判为正常的胸片分类COVID或非COVID的准确率为92%。
临床应用与阅片要点
- 作者认为AI算法可补充人类专家判断COVID状态。
- 作者认为AI与专家协作可能比单独考虑任一者时更高的准确率预测COVID状态。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVES: To study whether a trained convolutional neural network (CNN) can be of assistance to radiologists in differentiating Coronavirus disease (COVID)-positive from COVID-negative patients using chest X-ray (CXR) through an ambispective clinical study. To identify subgroups of patients where artificial intelligence (AI) can be of particular value and analyse what imaging features may have contributed to the performance of AI by means of visualisation techniques.
METHODS: CXR of 487 patients were classified into [4] categories-normal, classical COVID, indeterminate, and non-COVID by consensus opinion of 2 radiologists. CXR which were classified as "normal" and "indeterminate" were then subjected to analysis by AI, and final categorisation provided as guided by prediction of the network. Precision and recall of the radiologist alone and radiologist assisted by AI were calculated in comparison to reverse transcriptase-polymerase chain reaction (RT-PCR) as the gold standard. Attention maps of the CNN were analysed to understand regions in the CXR important to the AI algorithm in making a prediction.
RESULTS: The precision of radiologists improved from 65.9 to 81.9% and recall improved from 17.5 to 71.75 when assistance with AI was provided. AI showed 92% accuracy in classifying "normal" CXR into COVID or non-COVID. Analysis of attention maps revealed attention on the cardiac shadow in these "normal" radiographs.
CONCLUSION: This study shows how deployment of an AI algorithm can complement a human expert in the determination of COVID status. Analysis of the detected features suggests possible subtle cardiac changes, laying ground for further investigative studies into possible cardiac changes.
KEY POINTS: • Through an ambispective clinical study, we show how assistance with an AI algorithm can improve recall (sensitivity) and precision (positive predictive value) of radiologists in assessing CXR for possible COVID in comparison to RT-PCR. • We show that AI achieves the best results in images classified as "normal" by radiologists. We conjecture that possible subtle cardiac in the CXR, imperceptible to the human eye, may have contributed to this prediction. • The reported results may pave the way for a human computer collaboration whereby the expert with some help from the AI algorithm achieves higher accuracy in predicting COVID status on CXR than previously thought possible when considering either alone.
引用
- Rangarajan K, Muku S, Garg AK, et al. Artificial Intelligence-assisted chest X-ray assessment scheme for COVID-19. Eur Radiol. 2021. PMID: 33471219. doi:10.1007/s00330-020-07628-5
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。