树基模型的即插即用:对临床预测建模的影响
该文通过模拟研究、放疗毒性预测的真实临床示例及公开头颈癌数据集,展示即插即用使用随机森林和XGBoost等树基模型时,其学习的预测因子-结局关联呈阶梯式波动、非平滑非单调、难以学习可加效应,且外推时对超出观察数据范围的预测因子值预测恒定值;作者推荐在建模决策与评估中仔细考虑这些行为,并指出需进一步研究约束先验知识与软分裂决策树等新进展的价值。
要点
- 树基模型对连续预测因子的学习关联呈阶梯式波动,即使数据量大也不平滑、非单调。
- 树基模型因只能正交于坐标轴分裂而难以学习可加效应,外推时对超出观察范围的值预测恒定值。
- 作者推荐在建模决策与评估中仔细考虑树基模型的行为,并指出需进一步研究约束先验知识与软分裂决策树的价值。
核心结论
- 即插即用使用树基模型进行临床预测可能产生不理想的预测因子-结局关联。
- 作者推荐在建模决策与评估中仔细考虑树基模型的行为。
- 需进一步研究探索约束以纳入先验知识和软分裂决策树等决策树文献新进展的潜在价值。
研究设计与样本
- 模拟研究从标准正态分布采样预测因子,二分类结局由预测因子的逻辑函数决定。
- 真实世界临床示例为放疗后毒性预测。
- 公开数据集为头颈癌患者数据。
- 每种分析均在不同样本量下可视化学习的预测因子-结局关联。
主要发现
- 模拟研究中模型学习的连续预测因子-结局关联呈阶梯式波动,源于决策树对连续预测因子的固有分类。
- 即使数据量大,关联也不平滑或非单调。
- 树基模型因只能正交于坐标轴分裂而难以学习可加效应。
- 树基模型外推时对超出观察数据的预测因子值预测恒定值,无论预测因子值进一步增加。
- 临床示例与案例研究中学习的关联在生物学上不合理,可能引发泛化性与可信度问题。
临床怎么用
- 作者推荐在建模决策与评估中仔细考虑树基模型的行为。
局限性
- 需进一步研究探索约束以纳入先验知识和软分裂决策树等决策树文献新进展的潜在价值。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Tree-based models, such as random forest and XGBoost, are increasingly being used for clinical prediction, but certain aspects of their behavior are often overlooked. This article aims to illustrate these aspects and discuss the implications of plug-and-play use of tree-based models for clinical prediction. We focus on their ability to learn smooth, monotonic (ie, consistent predictor effect where an increase in predictor leads to an increase in predicted risk), and additive predictor-outcome associations (ie, each predictor independently and additively contributes to the outcome) and how they behave when making predictions outside the range of observed data (extrapolation). STUDY DESIGN AND SETTING: We illustrated the behavior of plug-and-play use of tree-based models in a simulation study where we sampled predictors from standard normal distributions and binary outcomes determined by the logistic function of the predictors, and translate this into potential clinical implications in a real-world clinical example of post-radiotherapy toxicity prediction. To show the generalizability of our findings, we also assessed the model's behavior in a publicly available dataset of patients with head and neck cancer. For each analysis we visualized the learned predictor-outcome associations across different sample sizes. RESULTS: In the simulation study, the models show stepwise fluctuations in their learned continuous predictor-outcome associations, which is caused by the inherent categorization of continuous predictors in a decision tree. Even with a large data size, the associations were not smooth or monotonic. Furthermore, because tree-based models can only split orthogonally to the axes, they struggle to learn an additive effect. Additionally, tree-based models extrapolate in a somewhat unintuitive way, by predicting a constant value beyond the observed data, regardless of further increases in predictor values. Using the clinical example and case study, we highlight that the learned associations are biologically implausible and may lead to issues regarding generalizability and trustworthiness. CONCLUSION: Using tree-based models in a plug-and-play manner for clinical prediction may result in undesirable predictor-outcome associations. Therefore, we recommend carefully taking their behavior into account during modeling decisions and evaluations. Further research is needed to explore the potential value of recent developments in decision tree literature, such as using constraints to incorporate prior knowledge and using soft-split decision trees. PLAIN LANGUAGE SUMMARY: In healthcare, statistical models can be used to predict a patient's risk of having or developing certain medical conditions. These predictions can be used for diagnosis, treatment planning, or informing patients. While there are many ways to build these models, a method that uses decision trees (and collections of these trees like random forest and XGBoost) has become increasingly popular. In our work, we used simulations and real patient data, to illustrate how these tree-based models learn from data. We show that these models inherently learn associations that are often biologically unrealistic, even when a lot of data are available. For example, when a predictive variable (e.g., body mass index) increases, we would expect smooth, gradual changes in risk. Instead, tree-based models tend to make sudden, unrealistic jumps or unexpected drops in their predictions. To discuss why this is relevant, we examined a case study in radiotherapy, where doctors use models to predict treatment side effects, based on variables such as the planned radiation dose. Here, the behavior of tree-based models sometimes leads to predictions where a tiny increase in radiation dose would either suddenly decrease the risk of side effects (which is not biologically plausible) or cause a dramatic increase in risk. Such biologically implausible predictions could result in a lack of trust from clinicians and potentially lead to suboptimal treatment decisions. While tree-based models are powerful methods, we argue that researchers should be aware of how these models learn and carefully evaluate whether this is acceptable for each specific clinical application. We also illustrate some promising solutions, such as forcing the models to incorporate existing medical knowledge, for example, by requiring that higher radiation doses must result in higher risks of side effects. Our work helps researchers understand the limitations and potential of these increasingly popular tree-based prediction methods and support their responsible use.
引用
- Meijerink LM, Schuit E, Moons KGM, et al. Plug-and-play use of tree-based methods: consequences for clinical prediction modeling. J Clin Epidemiol. 2025. PMID: 40398688. doi:10.1016/j.jclinepi.2025.111834
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。