多放射科医师用户研究:人工智能引导的胸片COVID-19肺病严重程度分级
这项回顾性多放射科医师用户研究评估人工智能系统PXS评分模型对154张COVID-19胸片四级严重程度分级的影响;使用AI系统后放射科医师间一致性Fleiss κ从0.40提高到0.66,三名胸科放射科医师使用更新版AI系统的Fleiss κ为0.74,严重程度分类与随后3天内插管或死亡显著相关。
要点
- 使用AI系统后放射科医师间分级一致性Fleiss κ从0.40提高到0.66。
- 三名胸科放射科医师使用更新版AI系统的Fleiss κ为0.74。
- 严重程度分类与随后3天内插管或死亡显著相关。
临床应用与阅片要点
- 作者结论认为,在胸片检查判读时使用AI系统可提高放射科医师间一致性。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
RATIONALE AND OBJECTIVES: Radiographic findings of COVID-19 pneumonia can be used for patient risk stratification; however, radiologist reporting of disease severity is inconsistent on chest radiographs (CXRs). We aimed to see if an artificial intelligence (AI) system could help improve radiologist interrater agreement.
MATERIALS AND METHODS: We performed a retrospective multi-radiologist user study to evaluate the impact of an AI system, the PXS score model, on the grading of categorical COVID-19 lung disease severity on 154 chest radiographs into four ordinal grades (normal/minimal, mild, moderate, and severe). Four radiologists (two thoracic and two emergency radiologists) independently interpreted 154 CXRs from 154 unique patients with COVID-19 hospitalized at a large academic center, before and after using the AI system (median washout time interval was 16 days). Three different thoracic radiologists assessed the same 154 CXRs using an updated version of the AI system trained on more imaging data. Radiologist interrater agreement was evaluated using Cohen and Fleiss kappa where appropriate. The lung disease severity categories were associated with clinical outcomes using a previously published outcomes dataset using Fisher's exact test and Chi-square test for trend.
RESULTS: Use of the AI system improved radiologist interrater agreement (Fleiss κ = 0.40 to 0.66, before and after use of the system). The Fleiss κ for three radiologists using the updated AI system was 0.74. Severity categories were significantly associated with subsequent intubation or death within 3 days.
CONCLUSION: An AI system used at the time of CXR study interpretation can improve the interrater agreement of radiologists.
引用
- Li MD, Little BP, Alkasab TK, et al. Multi-Radiologist User Study for Artificial Intelligence-Guided Grading of COVID-19 Lung Disease Severity on Chest Radiographs. Acad Radiol. 2021. PMID: 33485773. doi:10.1016/j.acra.2021.01.016
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。