深度学习在膝关节MRI上检测前交叉韧带撕裂:多大陆外部验证
研究利用19,765例膝关节MRI(17,738例患者)构建深度学习前交叉韧带撕裂检测算法,其中15%显示部分或完全撕裂,采用冠状位和矢状位脂肪抑制质子密度或T2加权序列,并用自然语言处理自动标注报告。模型在Bien等美国数据集和Stajduhar等克罗地亚数据集上外部验证,AUC分别为0.962和0.922。
要点
- 算法在外部数据集Bien上AUC为0.962,敏感度85%、特异度89%、准确率0.875。
- 算法在外部数据集Stajduhar上AUC为0.922,敏感度68%、特异度93%、准确率0.870。
- 模型在不同制造商和人群间表现出泛化能力。
核心结论
- 该算法在检测前交叉韧带撕裂方面表现出高性能,在两个外部数据集上的AUC表明其在不同制造商和人群中具有泛化能力,并在与美国和克罗地亚不同国家及大陆的人群中进行了外部验证。
研究设计与样本
- 研究基于19,765例膝关节MRI(17,738例患者)构建深度学习前交叉韧带撕裂检测器,使用不同制造商和磁场设备,采用冠状位和矢状位脂肪抑制质子密度或T2加权序列,并用自然语言处理算法自动标注报告。
诊断标准与关键数值
- 模型在原始数据集上检测前交叉韧带撕裂的AUC为0.939,敏感度87%(0.875),特异度91%(0.908)。
- 在Bien数据集上重新训练后,AUC为0.962(95% CI 0.930-0.988),敏感度85%(95% CI 75-94%,0.852),特异度89%(95% CI 82-97%,0.894),准确率0.875(95% CI 0.817-0.933)。
- 在Stajduhar数据集上重新训练后,AUC为0.922(95% CI 0.875-0.962),敏感度68%(95% CI 54-81%,0.681),特异度93%(95% CI 89-97%,0.934),准确率0.870(95% CI 0.821-0.913)。
临床应用与阅片要点
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVES: To develop a deep-learning algorithm for anterior cruciate ligament (ACL) tear detection and to compare its accuracy using two external datasets.
METHODS: A database of 19,765 knee MRI scans (17,738 patients) issued from different manufacturers and magnetic fields was used to build a deep learning-based ACL tear detector. Fifteen percent showed partial or complete ACL rupture. Coronal and sagittal fat-suppressed proton density or T2-weighted sequences were used. A Natural Language Processing algorithm was used to automatically label reports associated with each MRI exam. We compared the accuracy of our model on two publicly available external datasets: MRNet, Bien et al, USA (PLoS Med 15:e1002699, 2018); and KneeMRI, Stajduhar et al, Croatia (Comput Methods Prog Biomed 140:151-164, 2017). Receptor operating characteristics (ROC) curves, area under the curve (AUC), sensitivity, specificity, and accuracy were used to evaluate our model.
RESULTS: Our neural networks achieved an AUC value of 0.939 for detection of ACL tears, with a sensitivity of 87% (0.875) and a specificity of 91% (0.908). After retraining our model on Bien dataset and Stajduhar dataset, our algorithm achieved AUC of 0.962 (95% CI 0.930-0.988) and 0.922 (95% CI 0.875, 0.962) respectively. Sensitivity, specificity, and accuracy were respectively 85% (95% CI 75-94%, 0.852), 89% (95% CI 82-97%, 0.894), 0.875 (95% CI 0.817-0.933) for Bien dataset, and 68% (95% CI 54-81%, 0.681), 93% (95% CI 89-97%, 0.934), and 0.870 (95% CI 0.821-0.913) for Stajduhar dataset.
CONCLUSION: Our algorithm showed high performance in the detection of ACL tears with AUC on two external datasets, demonstrating its generalizability on different manufacturers and populations. This study shows the performance of an algorithm for detecting anterior cruciate ligament tears with an external validation on populations from countries and continents different from the study population.
KEY POINTS: • An algorithm for detecting anterior cruciate ligament ruptures was built from a large dataset of nearly 20,000 MRI with AUC values of 0.939, sensitivity of 87%, and specificity of 91%. • This algorithm was tested on two external populations from different other countries: a dataset from an American population and a dataset from a Croatian population. Performance remains high on these two external validation populations (AUC of 0.962 and 0.922 respectively).
引用
- Tran, Lassalle, Zille, et al. Deep learning to detect anterior cruciate ligament tear on knee MRI: multi-continental external validation. Eur Radiol. 2022. PMID: 35726103. doi:10.1007/s00330-022-08923-z
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。