采用软标签方法开发可纳入胸部CT肺实变不确定性的自动化算法:基于COVID-19肺炎的研究
研究回顾性纳入五家国际中心2020年1月至6月的760例COVID-19胸部CT,对超过27000个轴位层面创建像素级标签,分类纯磨玻璃、碎石路和实变三种肺实变模式并量化%WAL;软标签方法将预测实变类型和范围的逐点准确率从60.0%提高到84.3%(p=0.01),预测%WAL的R=0.900,较硬标签模型的R=0.856提高但未达统计学显著(p=0.349)。
要点
- 12名放射科医生标注的硬标签存在较大观察者间变异,仅3.37%像素达到完全一致。
- 软标签方法将预测实变类型和范围的逐点准确率从60.0%提高到84.3%(p=0.01)。
- 软标签模型预测%WAL的R=0.900,硬标签模型R=0.856,差异未达统计学显著(p=0.349)。
核心结论
- 软标签方法提高了胸部CT肺实变自动量化和分类的准确率;模型虽在COVID-19上开发,但意图广泛用于肺实变场景并为未来软标签方法开发提供基础。
研究设计与样本
- 回顾性研究,从五家国际中心纳入2020年1月至6月的760例COVID-19胸部CT,对超过27000个轴位层面创建像素级标签,比较硬标签模型与软标签模型的性能。
关键影像表现/征象
- 像素级标签将肺实变分为纯磨玻璃、碎石路和实变三种模式。
- 硬标签由12名放射科医生标注,仅3.37%像素达到完全一致,观察者间变异大。
诊断标准与关键数值
- 以逐点准确率和实变标签与真实值的交并比评估模型性能,软标签模型逐点准确率84.3% vs 硬标签模型60.0%(p=0.01)。
- 以与真实%WAL的相关性评估,软标签模型R=0.900 vs 硬标签模型R=0.856(p=0.349,未达统计学显著)。
临床应用与阅片要点
- 软标签方法可减少标注负担并考虑分割肺实变时的不确定性。
- 原文未据此给出日常阅片推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
RATIONALE AND OBJECTIVES: Hard data labels for automated algorithm training are binary and cannot incorporate uncertainty between labels. We proposed and evaluated a soft labeling methodology to quantify opacification and percent well-aerated lung (%WAL) on chest CT, that considers uncertainty in segmenting pulmonary opacifications and reduces labeling burden.
MATERIALS AND METHODS: We retrospectively sourced 760 COVID-19 chest CT scans from five international centers between January and June 2020. We created pixel-wise labels for >27,000 axial slices that classify three pulmonary opacification patterns: pure ground-glass, crazy-paving, consolidation. We also quantified %WAL as the total area of lung without opacifications. Inter-user hard label variability was quantified using Shannon entropy (range=0-1.39, low-high entropy/variability). We incorporated a soft labeling and modeling cycle following an initial model with hard labels and compared performance using point-wise accuracy and intersection-over-union of opacity labels with ground-truth, and correlation with ground-truth %WAL.
RESULTS: Hard labels annotated by 12 radiologists demonstrated large inter-user variability (3.37% of pixels achieved complete agreement). Our soft labeling approach increased point-wise accuracy from 60.0% to 84.3% (p=0.01) compared to hard labeling at predicting opacification type and area involvement. The soft label model accurately predicted %WAL (R=0.900) compared to the hard label model (R=0.856), but the improvement was not statistically significant (p=0.349).
CONCLUSION: Our soft labeling approach increased accuracy for automated quantification and classification of pulmonary opacification on chest CT. Although we developed the model on COVID-19, our intent is broad application for pulmonary opacification contexts and to provide a foundation for future development using soft labeling methods.
引用
- Lensink, Lo, Eddy, et al. A Soft Labeling Approach to Develop Automated Algorithms that Incorporate Uncertainty in Pulmonary Opacification on Chest CT using COVID-19 Pneumonia. Acad Radiol. 2022. PMID: 35490114. doi:10.1016/j.acra.2022.03.025
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。