机器学习方法能否产生准确且易用的膝关节或髋关节置换术后30天并发症和死亡率预测模型?
本研究利用2013至2014年美国外科医师学会国家外科质量改进计划(ACS-NSQIP)中107,792例非急诊初次全髋和全膝关节置换术的患者数据,采用LASSO回归机器学习方法开发并内部及外部验证30天死亡和主要并发症的简约预测模型。模型对肾脏并发症(C统计量0.78)、死亡(0.73)和心脏并发症(0.73)区分度良好,但对静脉血栓栓塞(0.61)和任何并发症(0.64)区分度差。外部验证显示NSQIP模型对死亡和心脏并发症稳健,但对肾脏并发症不稳健;VASQIP模型在NSQIP数据中外部验证区分度差,提示不应在退伍军人健康管理局以外使用。
要点
- LASSO回归模型对30天肾脏并发症(C统计量0.78)、死亡(0.73)和心脏并发症(0.73)区分度良好。
- 模型对静脉血栓栓塞(C统计量0.61)和任何并发症(0.64)区分度差。
- VASQIP数据外部验证NSQIP模型对死亡和心脏并发症稳健,但对肾脏并发症不稳健。
核心结论
- 开发了择期初次全关节置换术后30天死亡和心脏并发症的中等准确度预测模型,并完成内部和外部验证。
- 据作者所知,这是目前最准确且严格验证的全关节置换术特异性预测模型(http://med.stanford.edu/s-spire/Resources/clinical-tools-.html)。
- 应探索改进模型的方法,包括添加非标准输入如术前临床病程记录或放射影像的自然语言处理,并开发和验证预测长期疼痛和功能改善的模型。
研究设计与样本
- 使用2013至2014年ACS-NSQIP中所有107,792例非急诊初次全髋和全膝关节置换术的术前人口学和临床变量作为30天死亡和主要并发症的预测因子。
- 采用LASSO回归(一种机器学习方法)进行模型开发,使用十折交叉验证产生C统计量。
- 使用VASQIP数据进行外部验证,并用NSQIP数据外部验证既往从VASQIP数据开发的模型。
- 证据等级:III级,诊断性研究。
主要发现
- 模型对30天肾脏并发症的C统计量为0.78(95%CI 0.76-0.80),死亡为0.73(95%CI 0.70-0.76),心脏并发症为0.73(95%CI 0.71-0.75)。
- 模型对静脉血栓栓塞的C统计量为0.61(95%CI 0.60-0.62),任何并发症为0.64(95%CI 0.63-0.65)。
- 用VASQIP数据外部验证NSQIP衍生模型,对死亡和心脏并发症的预测稳健,但对肾脏并发症的预测不稳健。
- 既往用VASQIP数据开发的模型在NSQIP数据外部验证时区分度差,提示不应在退伍军人健康管理局背景之外使用。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Existing universal and procedure-specific surgical risk prediction models of death and major complications after elective total joint arthroplasty (TJA) have limitations including poor transparency, poor to modest accuracy, and insufficient validation to establish performance across diverse settings. Thus, the need remains for accurate and validated prediction models for use in preoperative management, informed consent, shared decision-making, and risk adjustment for reimbursement. QUESTIONS/PURPOSES: The purpose of this study was to use machine learning methods and large national databases to develop and validate (both internally and externally) parsimonious risk-prediction models for mortality and complications after TJA. METHODS: Preoperative demographic and clinical variables from all 107,792 nonemergent primary THAs and TKAs in the 2013 to 2014 American College of Surgeons-National Surgical Quality Improvement Program (ACS-NSQIP) were evaluated as predictors of 30-day death and major complications. The NSQIP database was chosen for its high-quality data on important outcomes and rich characterization of preoperative demographic and clinical predictors for demographically and geographically diverse patients. Least absolute shrinkage and selection operator (LASSO) regression, a type of machine learning that optimizes accuracy and parsimony, was used for model development. Tenfold validation was used to produce C-statistics, a measure of how well models discriminate patients who experience an outcome from those who do not. External validation, which evaluates the generalizability of the models to new data sources and patient groups, was accomplished using data from the Veterans Affairs Surgical Quality Improvement Program (VASQIP). Models previously developed from VASQIP data were also externally validated using NSQIP data to examine the generalizability of their performance with a different group of patients outside the VASQIP context. RESULTS: The models, developed using LASSO regression with diverse clinical (for example, American Society of Anesthesiologists classification, comorbidities) and demographic (for example, age, gender) inputs, had good accuracy in terms of discriminating the likelihood a patient would experience, within 30 days of arthroplasty, a renal complication (C-statistic, 0.78; 95% confidence interval [CI], 0.76-0.80), death (0.73; 95% CI, 0.70-0.76), or a cardiac complication (0.73; 95% CI, 0.71-0.75) from one who would not. By contrast, the models demonstrated poor accuracy for venous thromboembolism (C-statistic, 0.61; 95% CI, 0.60-0.62) and any complication (C-statistic, 0.64; 95% CI, 0.63-0.65). External validation of the NSQIP- derived models using VASQIP data found them to be robust in terms of predictions about mortality and cardiac complications, but not for predicting renal complications. Models previously developed with VASQIP data had poor accuracy when externally validated with NSQIP data, suggesting they should not be used outside the context of the Veterans Health Administration. CONCLUSIONS: Moderately accurate predictive models of 30-day mortality and cardiac complications after elective primary TJA were developed as well as internally and externally validated. To our knowledge, these are the most accurate and rigorously validated TJA-specific prediction models currently available (http://med.stanford.edu/s-spire/Resources/clinical-tools-.html). Methods to improve these models, including the addition of nonstandard inputs such as natural language processing of preoperative clinical progress notes or radiographs, should be pursued as should the development and validation of models to predict longer term improvements in pain and function. LEVEL OF EVIDENCE: Level III, diagnostic study.
引用
- Harris AHS, Kuo AC, Weng Y, et al. Can Machine Learning Methods Produce Accurate and Easy-to-use Prediction Models of 30-day Complications and Mortality After Knee or Hip Arthroplasty? Clin Orthop Relat Res. 2019. PMID: 30624314. doi:10.1097/CORR.0000000000000601
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。