样本外应答者中个体化治疗效应预测的验证
该文提出并测试一种在独立样本中验证连续结局个体化治疗效应预测的方法,利用测试样本中基于预测治疗应答与对照应答的匹配。模拟显示该算法能准确确认验证成立与不成立, nuisance 变量会损害性能且变量选择可部分缓解。在酒精使用障碍临床试验数据中应用验证了该流程。
要点
- 提出基于测试样本匹配的个体化治疗效应预测验证方法
- 模拟中算法能准确确认验证成立与不成立
- nuisance 变量损害算法性能,变量选择可部分缓解
核心结论
- 验证算法能准确确认验证成立与不成立,并为测试数据在相似但非相同条件下生成的情况提供洞察。
- nuisance 变量的存在对算法性能有不利影响,可通过变量选择方法部分减少。
- 该方法的一个优势是可广泛应用于不同的预测方法。
研究设计与样本
- 研究通过模拟生成与训练数据相同、相似或不相关过程的测试数据来检验所提出的验证方法,并考察 nuisance 变量的影响。
- 研究使用酒精使用障碍联合行为与药物治疗临床试验的数据应用该验证流程。
主要发现
- 模拟中验证算法能准确确认验证成立与不成立。
- 算法为测试数据在相似但非相同条件下生成的情况提供洞察。
- nuisance 变量对算法性能有不利影响,变量选择方法可部分减少该影响。
临床怎么用
- 作者提出的验证流程可用于在独立数据中验证个体化治疗效应预测,以支持其临床应用。
- 该验证方法可广泛应用于不同的预测方法。
局限性
- nuisance 变量的存在对算法性能有不利影响。
- 变量选择方法只能部分减少 nuisance 变量对算法性能的不利影响。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
Personalized medicine promises the ability to improve patient outcomes by tailoring treatment recommendations to the likelihood that any given patient will respond well to a given treatment. It is important that predictions of treatment response be validated and replicated in independent data to support their use in clinical practice. In this paper, we propose and test an approach for validating predictions of individual treatment effects with continuous outcomes across samples that uses matching in a test (validation) sample to match individuals in the treatment and control arms based on their predicted treatment response and their predicted response under control. To examine the proposed validation approach, we conducted simulations where test data is generated from either an identical, similar, or unrelated process to the training data. We also examined the impact of nuisance variables. To demonstrate the use of this validation procedure in the context of predicting individual treatment effects in the treatment of alcohol use disorder, we apply our validation procedure using data from a clinical trial of combined behavioral and pharmacotherapy treatments. We find that the validation algorithm accurately confirms validation and lack of validation, and also provides insights into cases where test data were generated under similar, but not identical conditions. We also show that the presence of nuisance variables detrimentally impacts algorithm performance, which can be partially reduced though the use of variable selection methods. An advantage of the approach is that it can be widely applied to different predictive methods.
引用
- Kuhlemeier A, Jaki T, Witkiewitz K, et al. Validation of predicted individual treatment effects in out of sample respondents. Stat Med. 2024. PMID: 39075029. doi:10.1002/sim.10187
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。