文献速递关节外科

机器学习算法能否预测丹麦膝关节置换登记系统中的早期翻修全膝关节置换术?

Can Machine-learning Algorithms Predict Early Revision TKA in the Danish Knee Arthroplasty Registry?
PubMed 文献 · Clin Orthop Relat Res · 2020-01-01

本研究利用丹麦膝关节置换登记系统2012至2015年的25,104例初次全膝关节置换术数据训练四种机器学习模型,并在2016年的6,170例数据中进行时间外部验证,以预测术后2年内翻修的可能性。结果显示模型区分度未超过无信息模型,AUC为0.57至0.60,未达到预设的0.7临床有用阈值,基于术前数据无法构建临床有用的早期翻修预测模型。

要点

  • 年龄、骨折后骨关节炎和体重被模型识别为重要的术前预测因素。
  • 验证时四种机器学习模型的AUC为0.57至0.60,与无信息模型表现无差异。
  • 未达到预设AUC 0.7的临床有用模型阈值,基于术前数据预测早期翻修困难。

核心结论

  • 尽管结合了已知的术前翻修风险因素和四种机器学习方法,仍无法基于丹麦膝关节置换登记系统的术前数据开发出临床有用的早期全膝关节置换翻修预测模型。

研究设计与样本

  • 使用丹麦膝关节置换登记系统2012年至2015年的25,104例初次全膝关节置换术作为训练集,2016年的6,170例作为时间外部验证集。
  • 构建了四种预测模型:使用LASSO的逻辑回归模型、随机森林、梯度提升模型和有监督神经网络,并与预测所有观察均未翻修的无信息模型比较。
  • 模型训练采用10折交叉验证,并通过过采样翻修观察和欠采样未翻修观察调整低翻修比例;随访2年,翻修定义为移除、更换或增加植入物。

主要发现

  • 基于模型训练,年龄、骨折后骨关节炎和体重被认为是机器学习模型中重要的术前因素。
  • 验证期间,模型表现与无信息模型无差异,AUC范围为0.57至0.60。
  • 没有模型达到预设的AUC 0.7临床有用区分能力阈值。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Revision TKA is a serious adverse event with substantial consequences for the patient. As the demand for TKA rises, reducing the risk of revision TKA is becoming increasingly important. Predictive tools based on machine-learning algorithms could reform clinical practice. Few attempts have been made to combine machine-learning algorithms with data from nationwide arthroplasty registries and, to the authors' knowledge, none have tried to predict the likelihood of early revision TKA. QUESTION/PURPOSES: We used the Danish Knee Arthroplasty Registry to build models to predict the likelihood of revision TKA within 2 years of primary TKA and asked: (1) Which preoperative factors were the most important features behind these models' predictions of revision? (2) Can a clinically meaningful model be built on the preoperative factors included in the Danish Knee Arthroplasty Registry? METHODS: The Danish Knee Arthroplasty Registry collects patients' characteristics and surgical information from all arthroplasties conducted in Denmark and thus provides a large nationwide cohort of patients undergoing TKA. As training dataset, we retrieved all preoperative variables of 25,104 primary TKAs from 2012 to 2015. The same variables were retrieved from 6170 TKAs conducted in 2016, which were used as a hold-out year for temporal external validation. If a patient received bilateral TKA, only the first knee to receive surgery was included. All patients were followed for 2 years, with removal, exchange, or addition of an implant defined as TKA revision. We created four different predictive models to find the best performing model, including a regression-based model using logistic regression with least shrinkage and selection operator (LASSO), two classification tree models (random forest and gradient boosting model) and a supervised neural network. For comparison, we created a noninformative model predicting that all observations were unrevised. The four machine learning models were trained using 10-fold cross-validation on the training dataset after adjusting for the low percentage of revisions by over-sampling revised observations and undersampling unrevised observations. In the validation dataset, the models' performance was evaluated and compared by density plot, calibration plot, accuracy, Brier score, receiver operator characteristic (ROC) curve and area under the curve (AUC). The density plot depicts the distribution of probabilities and the calibration plot graphically depicts whether the predicted probability resembled the observed probability. The accuracy indicates how often the models' predictions were correct and the Brier score is the mean distance from the predicted probability to the observed outcome. The ROC curve is a graphical output of the models' sensitivity and specificity from which the AUC is calculated. The AUC can be interpreted as the likelihood that a model correctly classified an observation and thus, a priori, an AUC of 0.7 was chosen as threshold for a clinically meaningful model. RESULTS: Based the model training, age, postfracture osteoarthritis and weight were deemed as important preoperative factors within the machine learning models. During validation, the models' performance was not different from the noninformative models, and with AUCs ranging from 0.57 to 0.60, no models reached the predetermined AUC threshold for a clinical useful discriminative capacity. CONCLUSION: Although several well-known presurgical risk factors for revision were coupled with four different machine learning methods, we could not develop a clinically useful model capable of predicting early TKA revisions in the Danish Knee Arthroplasty Registry based on preoperative data. CLINICAL RELEVANCE: The inability to predict early TKA revision highlights that predicting revision based on preoperative information alone is difficult. Future models might benefit from including medical comorbidities and an anonymous surgeon identifier variable or may attempt to build a postoperative predictive model including intra- and postoperative factors as these may have a stronger association with early TKA revisions.

来源:Clin Orthop Relat Res,查看原文。版权归原作者所有。

引用

  1. El-Galaly A, Grazal C, Kappel A, et al. Can Machine-learning Algorithms Predict Early Revision TKA in the Danish Knee Arthroplasty Registry? Clin Orthop Relat Res. 2020. PMID: 32667760. doi:10.1097/CORR.0000000000001343

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。