最优动态治疗方案的同步特征选择
动态治疗方案(DTR)根据患者特征和健康状况在多阶段制定治疗决策。现有Q学习、O学习等方法逐阶段反向估计并正则化选变量,仅能识别各阶段不重要的调整变量,跨阶段累积假发现错误。作者提出L1多阶段斜坡损失(L1-MRL)学习框架,用单一多阶段斜坡损失同时估计所有阶段最优决策规则并执行跨阶段变量选择,理论上证明估计量相合且具有oracle性质,通过模拟和2型糖尿病电子健康记录数据应用展示其性能与现有方法相当或更优。
要点
- 现有逐阶段正则化方法仅识别各阶段不重要的调整变量,跨阶段假发现错误可能累积。
- L1-MRL用单一多阶段斜坡损失同时学习所有阶段最优决策规则并执行变量选择。
- 组Lasso型惩罚可识别对至少一个阶段决策重要的特征,估计量相合且具有oracle性质。
核心结论
- L1-MRL框架可同时学习所有阶段最优决策规则并执行跨阶段变量选择,估计量相合且具有oracle性质。
- 模拟研究和2型糖尿病电子健康记录数据应用显示,所提方法性能与许多现有具备变量选择能力的DTR方法相当或更优。
研究设计与样本
- 方法学论文,提出L1多阶段斜坡损失(L1-MRL)学习框架,用于学习最优动态治疗方案并同步进行跨阶段特征选择。
- 通过广泛模拟研究和2型糖尿病患者的电子健康记录(EHR)数据应用评估方法性能。
主要发现
- 现有Q学习和O学习等顺序方法逐阶段反向估计,每阶段正则化仅识别该阶段不重要的调整变量,跨阶段假发现错误可能累积。
- L1-MRL使用单一多阶段斜坡损失估计所有阶段的最优DTR,并施加组Lasso型惩罚对决策规则系数进行惩罚。
- 理论上证明估计量相合并具有朝向最优的oracle性质。
- 模拟研究和2型糖尿病EHR数据应用显示,所提方法性能与许多现有具备变量选择能力的DTR方法相当或更优。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Dynamic treatment regimens (DTRs), where treatment decisions are tailored to individual patient's characteristics and evolving health status over multiple stages, have gained increasing interest in the modern era of precision medicine. Identifying important features that drive these decisions over stages not only leads to parsimonious DTRs for practical use but also enhances the reliability of learning optimal DTRs. Existing methods for learning optimal DTRs, such as Q-learning and O-learning, rely on a sequential procedure to estimate the optimal decision at each stage backward. Incorporating feature selection in these methods through regularization at each stage of estimation only identifies unimportant tailoring variables at each stage but is not necessary for those variables that are not important across all the stages. As a result, false discovery errors are likely to accumulate over stages in these sequential methods. To overcome this limitation, we propose a framework, namely L1 multistage ramp loss (L1-MRL) learning, to learn the optimal decision rules and, at the same time, perform variable selection across all the stages simultaneously. This framework uses a single multistage ramp loss to estimate optimal DTRs for all stages. Furthermore, a group Lasso-type penalty is imposed to penalize the coefficients in the decision rules across all stages, which enables the identification of features that are important for at least one stage decision. Theoretically, we show that the estimator is consistent and enjoys the oracle property toward the optimal. We demonstrate that the proposed method performs equally well as or better than many existing DTR methods with variable selection capability via extensive simulation studies and an application to electronic health record (EHR) data for type 2 diabetes (T2D) patients.
引用
- Liu M, Wang Y, Zeng D, et al. Simultaneous Feature Selection for Optimal Dynamic Treatment Regimens. Stat Med. 2025. PMID: 40662759. doi:10.1002/sim.70169
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。