机器学习与逻辑回归算法预测骨科创伤手术结局的可行性
本研究利用9个已发表的肌肉骨骼创伤研究数据集,构建机器学习与逻辑回归模型预测特定骨折或不良事件概率,结果显示逻辑回归模型的平均c统计量较最佳机器学习模型高0.01(范围-0.01至0.06),机器学习模型中与变异强相关的变量较少且多与逻辑回归模型不同,提示机器学习在此背景下获益可能有限。
要点
- 逻辑回归模型平均c统计量较最佳机器学习模型高0.01(范围-0.01至0.06)。
- 机器学习模型中与变异强相关的变量较少,且多与逻辑回归模型不同。
- 机器学习对肌肉骨骼创伤二元事件概率估计的获益可能有限。
核心结论
- 机器学习模型对肌肉骨骼创伤二元事件产生的概率估计与逻辑回归模型相当,提示其在此背景下获益可能有限。
研究设计与样本
- 使用9个已发表的肌肉骨骼创伤研究数据集,每个数据集按80%训练集和20%测试集拆分,训练集采用五折交叉验证开发机器学习模型,并在独立测试集中评估最佳模型。
主要发现
- 逻辑回归模型较每个数据集的最佳机器学习模型平均c统计量高0.01(范围-0.01至0.06)。
- 机器学习模型中与变异强相关的变量较少,且许多与逻辑回归模型中的变量不同。
关键数值与推荐
- 模型性能通过区分度(c统计量)、校准度(斜率和截距)和整体性能(Brier评分)评估。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Statistical models using machine learning (ML) have the potential for more accurate estimates of the probability of binary events than logistic regression. The present study used existing data sets from large musculoskeletal trauma trials to address the following study questions: (1) Do ML models produce better probability estimates than logistic regression models? (2) Are ML models influenced by different variables than logistic regression models? METHODS: We created ML and logistic regression models that estimated the probability of a specific fracture (posterior malleolar involvement in distal spiral tibial shaft and ankle fractures, scaphoid fracture, and distal radial fracture) or adverse event (subsequent surgery [after distal biceps repair or tibial shaft fracture], surgical site infection, and postoperative delirium) using 9 data sets from published musculoskeletal trauma studies. Each data set was split into training (80%) and test (20%) subsets. Fivefold cross-validation of the training set was used to develop the ML models. The best-performing model was then assessed in the independent testing data. Performance was assessed by (1) discrimination (c-statistic), (2) calibration (slope and intercept), and (3) overall performance (Brier score). RESULTS: The mean c-statistic was 0.01 higher for the logistic regression models compared with the best ML models for each data set (range, -0.01 to 0.06). There were fewer variables strongly associated with variation in the ML models, and many were dissimilar from those in the logistic regression models. CONCLUSIONS: The observation that ML models produce probability estimates comparable with logistic regression models for binary events in musculoskeletal trauma suggests that their benefit may be limited in this context.
引用
- Oosterhoff JHF, Gravesteijn BY, Karhade AV, et al. Feasibility of Machine Learning and Logistic Regression Algorithms to Predict Outcome in Orthopaedic Trauma Surgery. J Bone Joint Surg Am. 2022. PMID: 34921550. doi:10.2106/JBJS.21.00341
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。