RSNA 2020肺栓塞检测挑战赛获胜深度学习算法的外部验证
回顾性分析两家医院疑似肺栓塞患者的连续CTPA图像,将RSNA 2020肺栓塞检测挑战赛获胜深度学习算法在RSPECT数据集上再训练后,于A院238例MDCT图像和B院114例SDCT及虚拟单能图像上测试,并与至少两名心胸放射科医师共识判读的参考标准比较。A院AUC为0.96(95%CI 0.92-0.98),B院常规重建AUC为0.89(95%CI 0.81-0.94),虚拟单能图像AUC为0.87(95%CI 0.80-0.93)。算法在MDCT图像上诊断准确度高,在SDCT图像上表现略低,提示对新CT技术额外训练可能提高算法泛化能力。
要点
- A院MDCT图像上算法AUC达0.96(95%CI 0.92-0.98),诊断准确度高。
- B院SDCT常规重建AUC为0.89(95%CI 0.81-0.94),虚拟单能图像AUC为0.87(95%CI 0.80-0.93),表现略低于MDCT。
- 参考标准为至少两名经验丰富的心胸放射科医师共识判读。
核心结论
- RSNA 2020肺栓塞检测挑战赛获胜深度学习算法在RSPECT数据集再训练后,在MDCT图像上显示高诊断准确度,在SDCT图像上表现略低,提示对新CT技术额外训练可能提高算法泛化能力。
研究设计与样本
- 回顾性分析两家医院因疑似肺栓塞转诊患者的连续CTPA图像;获胜算法在RSNA-STR肺栓塞CT(RSPECT)数据集上再训练;A院238例多探测器CT(MDCT)图像测试,B院114例频谱探测器CT(SDCT)及虚拟单能图像(VMI)测试;参考标准为至少两名经验丰富的心胸放射科医师共识判读。
诊断标准与关键数值
- 根据参考标准,A院73例(30.7%)存在肺栓塞,B院33例(29.0%)存在肺栓塞;A院算法AUC为0.96(95%CI 0.92-0.98),B院常规重建AUC为0.89(95%CI 0.81-0.94),VMI AUC为0.87(95%CI 0.80-0.93);敏感度和特异度采用最大约登指数确定,原文未报告具体数值。
临床应用与阅片要点
- 作者认为SDCT图像上表现略低提示对新CT技术额外训练可能提高该深度学习算法的泛化能力。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: To evaluate the diagnostic performance and generalizability of the winning DL algorithm of the RSNA 2020 PE detection challenge to a local population using CTPA data from two hospitals.
MATERIALS AND METHODS: Consecutive CTPA images from patients referred for suspected PE were retrospectively analysed. The winning RSNA 2020 DL algorithm was retrained on the RSNA-STR Pulmonary Embolism CT (RSPECT) dataset. The algorithm was tested in hospital A on multidetector CT (MDCT) images of 238 patients and in hospital B on spectral detector CT (SDCT) and virtual monochromatic images (VMI) of 114 patients. The output of the DL algorithm was compared with a reference standard, which included a consensus reading by at least two experienced cardiothoracic radiologists for both hospitals. Areas under the receiver operating characteristic curve (AUCs) were calculated. Sensitivity and specificity were determined using the maximum Youden index.
RESULTS: According to the reference standard, PE was present in 73 patients (30.7%) in hospital A and 33 patients (29.0%) in hospital B. For the DL algorithm the AUC was 0.96 (95% CI 0.92-0.98) in hospital A, 0.89 (95% CI 0.81-0.94) for conventional reconstruction in hospital B and 0.87 (95% CI 0.80-0.93) for VMI.
CONCLUSION: The RSNA 2020 pulmonary embolism detection on CTPA challenge winning DL algorithm, retrained on the RSPECT dataset, showed high diagnostic accuracy on MDCT images. A somewhat lower performance was observed on SDCT images, which suggest additional training on novel CT technology may improve generalizability of this DL algorithm.
引用
- Langius-Wiffen E, Slotman DJ, Groeneveld J, et al. External validation of the RSNA 2020 pulmonary embolism detection challenge winning deep learning algorithm. Eur J Radiol. 2024. PMID: 38401407. doi:10.1016/j.ejrad.2024.111361
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。