预测肩袖撕裂的可修复性:机器学习及与既往评分系统的比较
本研究基于术前MRI上前后径和内外侧径均>1 cm的关节镜肩袖修复术患者,开发机器学习模型预测肩袖撕裂可修复性,并与既往评分系统比较。弹性网逻辑回归在测试集表现最佳(AUROC 0.847),可提供可及的在线模型;作者提醒临床医生在原始队列之外部署预测模型时应谨慎,不应仅依赖模型输出。
要点
- 弹性网逻辑回归模型在测试集AUROC为0.847,调整后评分系统为0.786,既往两个评分系统分别为0.757和0.687。
- 训练集和内部验证集共429例患者,测试集112例患者。
- 作者认为机器学习模型性能与调整后评分系统相当,但临床医生在原始队列之外使用预测模型时应谨慎,不应仅依赖模型输出。
核心结论
- 机器学习模型可提供肩袖撕裂可修复性的概率估计,其性能与调整后评分系统相当。
- 作者认为,在原始队列之外部署预测模型时,无论依赖机器学习还是评分系统,临床医生均应谨慎,不应仅依赖模型输出。
研究设计与样本
- 队列研究,证据等级3级;纳入术前MRI上前后径和内外侧径均>1 cm的关节镜肩袖修复术患者。
- 训练集占70%,内部验证集占30%;外部验证由2名不同外科医生完成的肩袖修复术组成测试集。
- 使用训练集开发机器学习模型和新调整的评分系统,在测试集比较模型(包括调整后评分系统和2个既往评分系统)的性能。
主要发现
- 训练集和内部验证集共纳入429例患者,测试集纳入112例患者。
- 在测试集中,弹性网逻辑回归表现最佳,AUROC为0.847,基于调整后评分系统的净重分类改善为0.071。
- 调整后评分系统的AUROC为0.786,既往评分系统的AUROC分别为0.757和0.687。
- 弹性网逻辑回归被转化为可及的在线模型。
关键数值与推荐
- 弹性网逻辑回归在测试集的AUROC为0.847,净重分类改善为0.071(基于调整后评分系统)。
- 调整后评分系统在测试集的AUROC为0.786;既往评分系统在测试集的AUROC分别为0.757和0.687。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Repair of rotator cuff tear is not always feasible, depending on the severity. Although several studies have investigated factors related to reparability and various methods to predict it, inconsistent scoring methods and a lack of validation have hindered the utility of these methods. PURPOSE: To develop machine learning models to predict the reparability of rotator cuff tears, compare them with previous scoring systems, and provide an accessible online model. STUDY DESIGN: Cohort study; Level of evidence, 3. METHODS: Arthroscopic rotator cuff repairs for tears with both anteroposterior and mediolateral diameters >1 cm on preoperative magnetic resonance imaging were included and divided into a training set (70%) and an internal validation set (30%). For external validation, rotator cuff repairs performed by 2 different surgeons were included in a test set. Machine learning models and a newly adjusted scoring system were developed using the training set. The performance of the models including the adjusted scoring system and 2 previous scoring systems were compared using the test set. The performance was assessed using metrics such as the area under the receiver operating characteristic curve (AUROC) and compared using the net reclassification improvement based on the adjusted scoring system. RESULTS: A total of 429 patients were included for the training and internal validation set, and 112 patients were included for the test set. An elastic-net logistic regression demonstrated the best performance, with an AUROC of 0.847 and net reclassification improvement of 0.071, compared with the adjusted scoring system in the test set. The AUROC of the adjusted scoring system was 0.786, and the AUROCs of the previous scoring systems were 0.757 and 0.687. The elastic-net logistic regression was transformed into an accessible online model. CONCLUSION: The performance of the machine learning model, which provides a probability estimation for rotator cuff reparability, is comparable with that of the adjusted scoring system. Nevertheless, when deploying prediction models beyond the original cohort, regardless of whether they rely on machine learning or scoring systems, clinicians should exercise caution and not rely solely on the output of the model.
引用
- Do WS, Shin SH, Lim JR, et al. Predicting the Reparability of Rotator Cuff Tears: Machine Learning and Comparison With Previous Scoring Systems. Am J Sports Med. 2024. PMID: 39491518. doi:10.1177/03635465241287527
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。