文献速递运动医学创伤骨科

预测建模工具能否识别前交叉韧带重建术后长期阿片类药物使用高风险患者?

Can Predictive Modeling Tools Identify Patients at High Risk of Prolonged Opioid Use After ACL Reconstruction?
PubMed 文献 · Clin Orthop Relat Res · 2020-01-01

本研究基于军事健康系统数据,纳入2012年至2015年接受关节镜下前交叉韧带重建且术后随访至少90天的10919例患者,构建并验证四种机器学习模型预测术后90天以上仍填写阿片类药物处方的风险。梯度提升机模型最终表现最佳,内部验证AUC为0.77(95%CI 0.75-0.80),Brier评分为0.10(95%CI 0.09-0.11),决策曲线分析显示最佳临床效用,表明可术前识别高风险患者。

要点

  • 梯度提升机模型预测前交叉韧带重建术后长期阿片类药物使用,AUC为0.77(95%CI 0.75-0.80)。
  • 最终模型筛选出7个特征,术前吗啡当量、药房订购地点、部署时间和年龄等与结局相关。
  • 该模型可为患者和外科医生提供单一数值风险评分,辅助术前风险分层。

核心结论

  • 梯度提升机模型能够预测前交叉韧带重建术后长期阿片类药物使用风险,内部验证AUC为0.77(95%CI 0.75-0.80),Brier评分为0.10(95%CI 0.09-0.11),决策曲线分析显示最佳临床效用。

研究设计与样本

  • 回顾性队列研究,使用军事健康系统数据仓库纳入2012年1月至2015年12月接受关节镜下前交叉韧带重建(CPT 29888)且术后随访至少90天的10919例患者,多数为年轻现役男性。
  • 数据缺失3.3%,采用随机森林算法插补;数据按80%训练集和20%保留集划分,并按结局变量(术后90天阿片类药物使用)平衡。
  • 开发并比较逻辑回归、随机森林、贝叶斯信念网络和梯度提升机四种分类模型,通过AUC、Brier评分和决策曲线分析选择最佳模型。

主要发现

  • 随机森林模型内部验证AUC为0.76(95%CI 0.73-0.79),逻辑回归为0.76(95%CI 0.73-0.78),贝叶斯信念网络为0.73(95%CI 0.71-0.76),梯度提升机为0.72(95%CI 0.69-0.75)。
  • 经Boruta算法基于100棵树随机森林筛选特征后,最终保留7个特征。
  • 与长期阿片类药物使用正相关的特征包括术前使用吗啡当量(是)、特定药房订购地点、较短部署时间和较年轻年龄;负相关的特征包括特定药房订购地点、术前未使用吗啡当量、较长部署时间、美洲印第安人或阿拉斯加原住民种族和初级士兵军衔。
  • 最终调优的梯度提升机模型AUC为0.77(95%CI 0.75-0.80),Brier评分为0.10(95%CI 0.09-0.11),决策曲线分析显示最佳临床效用。

关键数值与推荐

  • 长期阿片类药物使用定义为前交叉韧带重建术后90天以上仍填写任何阿片类药物处方。
  • 模型预测性能以AUC大于0.70为基准 cutoff。

临床怎么用

  • 该梯度提升机模型可为每例患者生成单一数值风险评分,便于患者和外科医生理解,用于术前识别长期阿片类药物使用高风险患者。
  • 对高风险患者可加强术前支持和术后监测,以预防阿片类药物滥用和依赖。

局限性

  • 研究为内部验证,未进行外部验证,模型泛化能力需进一步确认。
  • 研究人群主要为年轻现役军人,结论外推至平民人群需谨慎。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Machine-learning methods such as the Bayesian belief network, random forest, gradient boosting machine, and decision trees have been used to develop decision-support tools in other clinical settings. Opioid abuse is a problem among civilians and military service members, and it is difficult to anticipate which patients are at risk for prolonged opioid use. QUESTIONS/PURPOSES: (1) To build a cross-validated model that predicts risk of prolonged opioid use after a specific orthopaedic procedure (ACL reconstruction), (2) To describe the relationships between prognostic and outcome variables, and (3) To determine the clinical utility of a predictive model using a decision curve analysis (as measured by our predictive system's ability to effectively identify high-risk patients and allow for preventative measures to be taken to ensure a successful procedure process). METHODS: We used the Military Analysis and Reporting Tool (M2) to search the Military Health System Data Repository for all patients undergoing arthroscopically assisted ACL reconstruction (Current Procedure Terminology code 29888) from January 2012 through December 2015 with a minimum of 90 days postoperative follow-up. In total, 10,919 patients met the inclusion criteria, most of whom were young men on active duty. We obtained complete opioid prescription filling histories from the Military Health System Data Repository's pharmacy records. We extracted data including patient demographics, military characteristics, and pharmacy data. A total of 3.3% of the data was missing. To curate and impute all missing variables, we used a random forest algorithm. We shuffled and split the data into 80% training and 20% hold-out sets, balanced by outcome variable (Outcome90Days). Next, the training set was further split into training and validation sets. Each model was built on the training data set, tuned with the validation set as applicable, and finally tested on the separate hold-out dataset. We chose four predictive models to develop, at the end choosing the best-fit model for implementation. Logistic regression, random forest, Bayesian belief network, and gradient boosting machine models were the four chosen models based on type of analysis (classification). Each were trained to estimate the likelihood of prolonged opioid use, defined as any opioid prescription filled more than 90 days after anterior cruciate reconstruction. After this, we tested the models on our holdout set and performed an area under the curve analysis concordance statistic, calculated the Brier score, and performed a decision curve analysis for validation. Then, we chose the method that produced the most suitable analysis results and, consequently, predictive power across the three calculations. Based on the calculations, the gradient boosting machine model was selected for future implementation. We systematically selected features and tuned the gradient boosting machine to produce a working predictive model. We performed area under the curve, Brier, and decision curve analysis calculations for the final model to test its viability and gain an understanding of whether it is possible to predict prolonged opioid use. RESULTS: Four predictive models were successfully developed using gradient boosting machine, logistic regression, Bayesian belief network, and random forest methods. After applying the Boruta algorithm for feature selection based on a 100-tree random forest algorithm, features were narrowed to a final seven features. The most influential features with a positive association with prolonged opioid use are preoperative morphine equivalents (yes), particular pharmacy ordering sites locations, shorter deployment time, and younger age. Those observed to have a negative association with prolonged opioid use are particular pharmacy ordering sites locations, preoperative morphine equivalents (no), longer deployment, race (American Indian or Alaskan native) and rank (junior enlisted).On internal validation, the models showed accuracy for predicting prolonged opioid use with AUC greater than our benchmark cutoff 0.70; random forest were 0.76 (95% confidence interval 0.73 to 0.79), 0.76 (95% CI 0.73 to 0.78), 0.73 (95% CI 0.71 to 0.76), and 0.72 (95% CI 0.69 to 0.75), respectively. Although the results from logistic regression and gradient boosting machines were very similar, only one model can be used in implementation. Based on our calculation of the Brier score, area under the curve, and decision curve analysis, we chose the gradient boosting machine as the final model. After selecting features and tuning the chosen gradient boosting machine, we saw an incremental improvement in our implementation model; the final model is accurate, with a Brier score of 0.10 (95% CI 0.09 to 0.11) and area under the curve of 0.77 (95% CI 0.75 to 0.80). It also shows the best clinical utility in a decision curve analysis. CONCLUSIONS: These scores support our claim that it is possible to predict which patients are at risk of prolonged opioid use, as seen by the appropriate range of hold-out analysis calculations. Current opioid guidelines recommend preoperative identification of at-risk patients, but available tools for this purpose are crude, largely focusing on identifying the presence (but not relative contributions) of various risk factors and screening for depression. The power of this model is that it will permit the development of a true clinical decision-support tool, which risk-stratifies individual patients with a single numerical score that is easily understandable to both patient and surgeon. Probabilistic models provide insight into how clinical factors are conditionally related. Not only will this gradient boosting machine be used to help understand factors contributing to opiate misuse after ACL reconstruction, but also it will allow orthopaedic surgeons to identify at-risk patients before surgery and offer increased support and monitoring to prevent opioid abuse and dependency. LEVEL OF EVIDENCE: Level III, therapeutic study.

来源:Clin Orthop Relat Res,查看原文。版权归原作者所有。

引用

  1. Anderson AB, Grazal CF, Balazs GC, et al. Can Predictive Modeling Tools Identify Patients at High Risk of Prolonged Opioid Use After ACL Reconstruction? Clin Orthop Relat Res. 2020. PMID: 32282466. doi:10.1097/CORR.0000000000001251

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。