股骨颈骨折患者内固定后存在转为关节置换的风险:一种机器学习算法
该研究基于FAITH试验中875例低能量股骨颈骨折内固定患者,采用随机森林等五种机器学习算法预测24个月内转为关节置换,结果显示各算法在训练集和测试集的区分度与校准度均不佳,AUC范围分别为0.57-0.64和0.49-0.73。
要点
- 在875例股骨颈骨折内固定患者中,18%(155/875)在24个月内转为全髋或半髋关节置换。
- 五种机器学习算法预测转关节置换的AUC在训练集为0.57-0.64,在测试集为0.49-0.73。
- 作者认为基于当前数据集预测性能差,未来需纳入更多变量并区分转关节置换的不同原因。
核心结论
- 尽管使用了全球范围内该主题可用的最佳数据集之一,训练出的算法预测性能仍然较差。
研究设计与样本
- 研究纳入FAITH试验中875例低能量股骨颈骨折患者,随机分配接受滑动髋螺钉或松质骨螺钉内固定。
- 所有患者随机分为训练集(80%)和测试集(20%),基于27个候选特征用随机森林算法筛选出10个预测因子,并训练五种机器学习算法。
主要发现
- 875例患者中18%(155/875)在24个月内转为全髋或半髋关节置换。
- 训练集中五种算法的AUC为0.57至0.64,校准斜率0.53至0.82,校准截距-0.04至0.05,Brier评分0.14至0.15。
- 测试集中AUC为0.49至0.73,校准斜率0.17至1.29,校准截距-1.28至0.34,Brier评分0.13至0.15。
关键数值与推荐
- 随机森林算法识别的10个预测因子为:BMI、心脏病、Garden分型、使用心脏药物、使用肺部药物、年龄、肺病、骨关节炎、性别和骨折线水平。
临床怎么用
- 原文未据此给出推荐。
局限性
- 如果当前数据集包含不同变量或更多患者,性能可能更好。
- 本研究将转为关节置换的各种原因合并分析,而分别预测 underlying pathology(如股骨头坏死或不愈合)可能更精确。
- 仅基于术前变量预测转为关节置换可能本身就很困难。
- 未来研究应旨在纳入更多变量并区分关节置换的不同原因。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Femoral neck fractures are common and are frequently treated with internal fixation. A major disadvantage of internal fixation is the substantially high number of conversions to arthroplasty because of nonunion, malunion, avascular necrosis, or implant failure. A clinical prediction model identifying patients at high risk of conversion to arthroplasty may help clinicians in selecting patients who could have benefited from arthroplasty initially. QUESTION/PURPOSE: What is the predictive performance of a machine-learning (ML) algorithm to predict conversion to arthroplasty within 24 months after internal fixation in patients with femoral neck fractures? METHODS: We included 875 patients from the Fixation using Alternative Implants for the Treatment of Hip fractures (FAITH) trial. The FAITH trial consisted of patients with low-energy femoral neck fractures who were randomly assigned to receive a sliding hip screw or cancellous screws for internal fixation. Of these patients, 18% (155 of 875) underwent conversion to THA or hemiarthroplasty within the first 24 months. All patients were randomly divided into a training set (80%) and test set (20%). First, we identified 27 potential patient and fracture characteristics that may have been associated with our primary outcome, based on biomechanical rationale and previous studies. Then, random forest algorithms (an ML learning, decision tree-based algorithm that selects variables) identified 10 predictors of conversion: BMI, cardiac disease, Garden classification, use of cardiac medication, use of pulmonary medication, age, lung disease, osteoarthritis, sex, and the level of the fracture line. Based on these variables, five different ML algorithms were trained to identify patterns related to conversion. The predictive performance of these trained ML algorithms was assessed on the training and test sets based on the following performance measures: (1) discrimination (the model's ability to distinguish patients who had conversion from those who did not; expressed with the area under the receiver operating characteristic curve [AUC]), (2) calibration (the plotted estimated versus the observed probabilities; expressed with the calibration curve intercept and slope), and (3) the overall model performance (Brier score: a composite of discrimination and calibration). RESULTS: None of the five ML algorithms performed well in predicting conversion to arthroplasty in the training set and the test set; AUCs of the algorithms in the training set ranged from 0.57 to 0.64, slopes of calibration plots ranged from 0.53 to 0.82, calibration intercepts ranged from -0.04 to 0.05, and Brier scores ranged from 0.14 to 0.15. The algorithms were further evaluated in the test set; AUCs ranged from 0.49 to 0.73, calibration slopes ranged from 0.17 to 1.29, calibration intercepts ranged from -1.28 to 0.34, and Brier scores ranged from 0.13 to 0.15. CONCLUSION: The predictive performance of the trained algorithms was poor, despite the use of one of the best datasets available worldwide on this subject. If the current dataset consisted of different variables or more patients, the performance may have been better. Also, various reasons for conversion to arthroplasty were pooled in this study, but the separate prediction of underlying pathology (such as, avascular necrosis or nonunion) may be more precise. Finally, it may be possible that it is inherently difficult to predict conversion to arthroplasty based on preoperative variables alone. Therefore, future studies should aim to include more variables and to differentiate between the various reasons for arthroplasty. LEVEL OF EVIDENCE: Level III, prognostic study.
引用
- van de Kuit A, Oosterhoff JHF, Dijkstra H, et al. Patients With Femoral Neck Fractures Are at Risk for Conversion to Arthroplasty After Internal Fixation: A Machine-learning Algorithm. Clin Orthop Relat Res. 2022. PMID: 35767811. doi:10.1097/CORR.0000000000002283
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。