文献速递关节外科

三种机器学习技术预测肩关节置换术后临床结局的准确性

What Is the Accuracy of Three Different Machine Learning Techniques to Predict Clinical Outcomes After Shoulder Arthroplasty?
PubMed 文献 · Clin Orthop Relat Res · 2020-01-01

基于6210例首次解剖型全肩关节置换(aTSA)或反式全肩关节置换(rTSA)患者数据,采用线性回归、XGBoost和Wide and Deep三种机器学习技术构建预测模型,评估术后多个时间点临床结局及达到MCID和实质性临床获益阈值的准确性。Wide and Deep技术平均绝对误差最小,预测模型对MCID和实质性临床获益的识别准确率较高。

要点

  • 三种机器学习技术预测aTSA和rTSA术后各时间点结局的准确性相似。
  • Wide and Deep技术平均绝对误差最小,对ASES评分预测误差±10.1~11.3分。
  • 模型识别达到MCID的准确率为PROMs 93%~99%,疼痛/功能/活动度85%~94%。

核心结论

  • 机器学习技术可利用术前数据准确预测肩关节置换术后多个时间点的临床结局。
  • 模型可术前识别患者是否可能达到MCID和实质性临床获益阈值,实现风险分层。

研究设计与样本

  • 对7811例接受同一假体设计肩关节置换患者的数据库进行机器学习分析。
  • 排除翻修、骨折指征和半肩置换后,6210例首次aTSA和rTSA患者中4782例(11198次术后随访)数据充足用于训练和测试。
  • 使用线性回归、XGBoost和Wide and Deep三种监督机器学习技术构建预测模型。

主要发现

  • 各技术预测每个结局指标的准确性相似,但技术间存在小差异。
  • Wide and Deep技术在所有术后时间点平均绝对误差最小。
  • Wide and Deep预测术后ASES评分误差±10.1~11.3分,UCLA评分±2.5~3.4,Constant评分±7.3~7.9,全局肩功能评分±1.0~1.4,VAS疼痛评分±1.2~1.4。
  • Wide and Deep预测主动外展误差±18~21°,前屈±15~17°,外旋±10~12°。
  • 模型识别达到MCID的准确率:PROMs 93%~99%,疼痛/功能/活动度85%~94%;识别达到实质性临床获益的准确率:PROMs 82%~93%,疼痛/功能/活动度78%~90%。

关键数值与推荐

  • 预测准确性以实际值与预测值之间的平均绝对误差量化。
  • 二分类准确性以精确率、召回率、准确率和受试者工作特征曲线下面积量化。
  • MCID和实质性临床获益阈值基于患者满意度锚定法确定。

临床怎么用

  • 三种商用机器学习技术可用于训练和测试预测aTSA和rTSA术后临床结局的模型。
  • 预测建模技术有望近期用于回答未解决的临床问题并辅助决策以改善肩关节置换术后结局。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Machine learning techniques can identify complex relationships in large healthcare datasets and build prediction models that better inform physicians in ways that can assist in patient treatment decision-making. In the domain of shoulder arthroplasty, machine learning appears to have the potential to anticipate patients' results after surgery, but this has not been well explored. QUESTIONS/PURPOSES: (1) What is the accuracy of machine learning to predict the American Shoulder and Elbow Surgery (ASES), University of California Los Angeles (UCLA), Constant, global shoulder function, and VAS pain scores, as well as active abduction, forward flexion, and external rotation at 1 year, 2 to 3 years, 3 to 5 years, and more than 5 years after anatomic total shoulder arthroplasty (aTSA) or reverse total shoulder arthroplasty (rTSA)? (2) What is the accuracy of machine learning to identify whether a patient will achieve clinical improvement that exceeds the minimum clinically important difference (MCID) threshold for each outcome measure? (3) What is the accuracy of machine learning to identify whether a patient will achieve clinical improvement that exceeds the substantial clinical benefit threshold for each outcome measure? METHODS: A machine learning analysis was conducted on a database of 7811 patients undergoing shoulder arthroplasty of one prosthesis design to create predictive models for multiple clinical outcome measures. Excluding patients with revisions, fracture indications, and hemiarthroplasty resulted in 6210 eligible primary aTSA and rTSA patients, of whom 4782 patients with 11,198 postoperative follow-up visits had sufficient preoperative, intraoperative, and postoperative data to train and test the predictive models. Preoperative clinical data from 1895 primary aTSA patients and 2887 primary rTSA patients were analyzed using three commercially available supervised machine learning techniques: linear regression, XGBoost, and Wide and Deep, to train and test predictive models for the ASES, UCLA, Constant, global shoulder function, and VAS pain scores, as well as active abduction, forward flexion, and external rotation. Our primary study goal was to quantify the accuracy of three machine learning techniques to predict each outcome measure at multiple postoperative timepoints after aTSA and rTSA using the mean absolute error between the actual and predicted values. Our secondary study goals were to identify whether a patient would experience clinical improvement greater than the MCID and substantial clinical benefit anchor-based thresholds of patient satisfaction for each outcome measure as quantified by the model classification parameters of precision, recall, accuracy, and area under the receiver operating curve. RESULTS: Each machine learning technique demonstrated similar accuracy to predict each outcome measure at each postoperative point for both aTSA and rTSA, though small differences in prediction accuracy were observed between techniques. Across all postsurgical timepoints, the Wide and Deep technique was associated with the smallest mean absolute error and predicted the postoperative ASES score to ± 10.1 to 11.3 points, the UCLA score to ± 2.5 to 3.4, the Constant score to ± 7.3 to 7.9, the global shoulder function score to ± 1.0 to 1.4, the VAS pain score to ± 1.2 to 1.4, active abduction to ± 18 to 21°, forward elevation to ± 15 to 17°, and external rotation to ± 10 to 12°. These models also accurately identified the patients who did and did not achieve clinical improvement that exceeded the MCID (93% to 99% accuracy for patient-reported outcome measures (PROMs) and 85% to 94% for pain, function, and ROM measures) and substantial clinical benefit (82% to 93% accuracy for PROMs and 78% to 90% for pain, function, and ROM measures) thresholds. CONCLUSIONS: Machine learning techniques can use preoperative data to accurately predict clinical outcomes at multiple postoperative points after shoulder arthroplasty and accurately risk-stratify patients by preoperatively identifying who may and who may not achieve MCID and substantial clinical benefit improvement thresholds for each outcome measure. CLINICAL RELEVANCE: Three different commercially available machine learning techniques were used to train and test models that predicted clinical outcomes after aTSA and rTSA; this device-type comparison was performed to demonstrate how predictive modeling techniques can be used in the near future to help answer unsolved clinical questions and augment decision-making to improve outcomes after shoulder arthroplasty.

来源:Clin Orthop Relat Res,查看原文。版权归原作者所有。

引用

  1. Kumar V, Roche C, Overman S, et al. What Is the Accuracy of Three Different Machine Learning Techniques to Predict Clinical Outcomes After Shoulder Arthroplasty? Clin Orthop Relat Res. 2020. PMID: 32332242. doi:10.1097/CORR.0000000000001263

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。