文献速递关节外科

机器学习算法预测初次全膝关节置换术后非家庭出院去向的泛化性内部与外部验证

Internal and External Validation of the Generalizability of Machine Learning Algorithms in Predicting Non-home Discharge Disposition Following Primary Total Knee Joint Arthroplasty.
PubMed 文献 · J Arthroplasty · 2023-02-09

本研究使用全国队列(424,354例)训练四种机器学习模型预测初次全膝关节置换术后非家庭出院,并在机构队列(10,196例)中进行外部验证;内部验证AUC 0.83–0.84,外部验证AUC升至0.88–0.89,人工神经网络与基于直方图的梯度提升表现最佳(平均AUC 0.89,校准斜率1.39,Brier分数0.14),住院时长、年龄、体重指数和性别是最强预测因素。

要点

  • 全国队列非家庭出院率为19.4%,机构队列为36.4%。
  • 内部验证AUC 0.83–0.84,外部验证AUC升至0.88–0.89。
  • 住院时长、年龄、体重指数和性别是初次全膝关节置换术后出院去向的最强预测因素。

核心结论

  • 机器学习模型在内部和外部验证中均表现出优异的预测性能,支持其在不同患者队列间的泛化性及在临床工作流程中的潜在适用性。

研究设计与样本

  • 使用全国队列训练四种机器学习模型,采用递归特征消除和超参数调优,通过五折交叉验证进行内部验证,并使用机构队列进行外部验证,评估区分度、校准度和临床效用。

主要发现

  • 全国队列424,354例患者非家庭出院率为19.4%,机构队列10,196例患者非家庭出院率为36.4%。
  • 模型预测的受试者工作特征曲线下面积在内部验证中为0.83至0.84,在外部验证中升至0.88至0.89。
  • 人工神经网络和基于直方图的梯度提升表现最佳,平均受试者工作特征曲线下面积为0.89,校准斜率为1.39,Brier分数为0.14。
  • 数据集间相似度低,表明外部验证可靠。
  • 住院时长、年龄、体重指数和性别是初次全膝关节置换术后出院去向的最强预测因素。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

BACKGROUND: Nonhome discharge disposition following primary total knee arthroplasty (TKA) is associated with a higher rate of complications and constitutes a socioeconomic burden on the health care system. While existing algorithms predicting nonhome discharge disposition varied in degrees of mathematical complexity and prediction power, their capacity to generalize predictions beyond the development dataset remains limited. Therefore, this study aimed to establish the machine learning model generalizability by performing internal and external validations using nation-scale and institutional cohorts, respectively. METHODS: Four machine learning models were trained using the national cohort. Recursive feature elimination and hyper-parameter tuning were applied. Internal validation was achieved through five-fold cross-validation during model training. The trained models' performance was externally validated using the institutional cohort and assessed by discrimination, calibration, and clinical utility. RESULTS: The national (424,354 patients) and institutional (10,196 patients) cohorts had non-home discharge rates of 19.4 and 36.4%, respectively. The areas under the receiver operating curve of the model predictions were 0.83 to 0.84 during internal validation and increased to 0.88 to 0.89 during external validation. Artificial neural network and histogram-based gradient boosting elicited the best performance with a mean area under the receiver operating curve of 0.89, calibration slope of 1.39, and Brier score of 0.14, which indicated that the two models were robust in distinguishing non-home discharge and well-calibrated with accurate predictions of the probabilities. The low inter-dataset similarity indicated reliable external validation. Length of stay, age, body mass index, and sex were the strongest predictors of discharge destination after primary TKA. CONCLUSION: The machine learning models demonstrated excellent predictive performance during both internal and external validations, supporting their generalizability across different patient cohorts and potential applicability in the clinical workflow.

来源:J Arthroplasty,查看原文。版权归原作者所有。

引用

  1. Chen TL, Buddhiraju A, Seo HH, et al. Internal and External Validation of the Generalizability of Machine Learning Algorithms in Predicting Non-home Discharge Disposition Following Primary Total Knee Joint Arthroplasty. J Arthroplasty. 2023. PMID: 36764409. doi:10.1016/j.arth.2023.01.065

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。