使用与不使用基于深度学习的计算机辅助诊断的放射科医生:在肺结节/肿块特征描述和诊断中的表现及观察者间一致性比较
本研究纳入2018年1月至3月大阪大学医院CT检出的101个肺结节/肿块(恶性55例),由15名独立放射科医生按经验分L(<3年)、M(3-5年)、H(>5年)三组,在有/无深度学习CAD辅助下评估15项特征及恶性诊断并记录评估时间。结果显示CAD使全部15名医生对边界不清、边缘不规则、形状不规则、钙化、胸膜接触及恶性的AUC显著提高(p<0.05),L组边缘不规则和形状不规则、M组边界不清和边缘不规则也显著提高,H组无显著提高;所有组及几乎所有项目的ICC改善,中位评估时间未因CAD延长。结论认为DL-CAD有助于放射科医生(尤其<5年经验者)准确描述和诊断肺结节/肿块,并提高观察者间可重复性。
要点
- DL-CAD使全部15名医生对边界不清、边缘不规则、形状不规则、钙化、胸膜接触及恶性的AUC显著提高(p<0.05)。
- 经验<3年组(L)边缘不规则和形状不规则AUC显著提高,3-5年组(M)边界不清和边缘不规则AUC显著提高,>5年组(H)无显著提高。
- 所有经验组及几乎所有评估项目的观察者间一致性(ICC)均有改善,中位评估时间未因CAD延长。
核心结论
- 基于深度学习的CAD有助于放射科医生(尤其<5年经验者)准确描述和诊断肺结节/肿块,并提高放射科医生间研究结果的可重复性。
研究设计与样本
- 研究共纳入2018年1月至3月大阪大学医院CT检出的101个结节/肿块(恶性55例),使用SYNAPSE SAI Viewer V1.4分析,15名独立放射科医生按经验分为L(<3年)、M(3-5年)、H(>5年)三组(每组n=5),在有/无CAD辅助下评估15项特征及恶性诊断并记录评估时间,以两名委员会认证胸部放射科医生设定的参考标准进行比较,采用多阅片者多病例方法分析AUC,并用组内相关系数(ICC)比较观察者间一致性。
关键影像表现/征象
- 全部15名放射科医生在CAD辅助下对边界不清、边缘不规则、形状不规则、钙化、胸膜接触及恶性的AUC显著提高(p<0.05)。
- L组(<3年)边缘不规则和形状不规则AUC显著提高(p<0.05),M组(3-5年)边界不清和边缘不规则AUC显著提高(p<0.05),H组(>5年)无显著提高。
- L组恶性AUC增幅最大(未达统计学显著)。
诊断标准与关键数值
- 以两名委员会认证胸部放射科医生设定的参考标准比较AUC,采用多阅片者多病例方法分析。
- 全部15名医生CAD辅助下边界不清、边缘不规则、形状不规则、钙化、胸膜接触及恶性AUC显著提高(p<0.05)。
- L组CAD辅助下边缘不规则和形状不规则AUC显著提高(p<0.05)。
- M组CAD辅助下边界不清和边缘不规则AUC显著提高(p<0.05)。
- H组CAD辅助下各项目AUC无显著提高。
临床应用与阅片要点
- DL-CAD可辅助放射科医生(尤其<5年经验者)提高肺结节/肿块特征描述和恶性诊断的准确性。
- CAD可提高放射科医生间研究结果的可重复性(ICC改善)。
- CAD未延长中位评估时间。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVES: To compare the performance of radiologists in characterizing and diagnosing pulmonary nodules/masses with and without deep learning (DL)-based computer-aided diagnosis (CAD).
METHODS: We studied a total of 101 nodules/masses detected on CT performed between January and March 2018 at Osaka University Hospital (malignancy: 55 cases). SYNAPSE SAI Viewer V1.4 was used to analyze the nodules/masses. In total, 15 independent radiologists were grouped (n = 5 each) according to their experience: L (< 3 years), M (3-5 years), and H (> 5 years). The likelihoods of 15 characteristics, such as cavitation and calcification, and the diagnosis (malignancy) were evaluated by each radiologist with and without CAD, and the assessment time was recorded. The AUCs compared with the reference standard set by two board-certified chest radiologists were analyzed following the multi-reader multi-case method. Furthermore, interobserver agreement was compared using intraclass correlation coefficients (ICCs).
RESULTS: The AUCs for ill-defined boundary, irregular margin, irregular shape, calcification, pleural contact, and malignancy in all 15 radiologists, irregular margin and irregular shape in L and ill-defined boundary and irregular margin in M improved significantly (p < 0.05); no significant improvements were found in H. L showed the greatest increase in the AUC for malignancy (not significant). The ICCs improved in all groups and for nearly all items. The median assessment time was not prolonged by CAD.
CONCLUSIONS: DL-based CAD helps radiologists, particularly those with < 5 years of experience, to accurately characterize and diagnose pulmonary nodules/masses, and improves the reproducibility of findings among radiologists.
KEY POINTS: • Deep learning-based computer-aided diagnosis improves the accuracy of characterizing nodules/masses and diagnosing malignancy, particularly by radiologists with < 5 years of experience. • Computer-aided diagnosis increases not only the accuracy but also the reproducibility of the findings across radiologists.
引用
- Wataya, Yanagawa, Tsubamoto, et al. Radiologists with and without deep learning-based computer-aided diagnosis: comparison of performance and interobserver agreement for characterizing and diagnosing pulmonary nodules/masses. Eur Radiol. 2022. PMID: 35751697. doi:10.1007/s00330-022-08948-4
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。