文献速递流行病学与生物统计医学人工智能与信息学

评估生存模型在个体化治疗选择中的性能

Measuring the Performance of Survival Models to Personalize Treatment Choices.
PubMed 文献 · Stat Med · 2025-01-01

该文针对生存(时间至事件)结局,扩展了评估个体化治疗获益预测模型性能的方法。文章提供参与者水平治疗获益的替代定义,总结并新提出评估获益区分度、校准度和决策准确性的指标,并用模拟数据及OPERAM试验(多病共存老年人随机对照试验)真实数据演示。这些指标可用于统计和机器学习模型的开发(模型选择或内部验证)及外部验证阶段,并提供R代码实现所有模型和指标。

要点

  • 针对生存结局提出参与者水平治疗获益的替代定义。
  • 总结并新提出评估治疗获益模型区分度、校准度和决策准确性的指标。
  • 指标适用于统计与机器学习模型,可用于模型开发及外部验证,并提供R代码。

核心结论

  • 扩展的方法可评估生存结局下个体化治疗获益预测模型的性能,包括区分度、校准度和决策准确性。

研究设计与样本

  • 方法学文章,使用模拟数据和OPERAM随机对照试验的真实数据演示,该试验将多病共存老年人随机分配至标准治疗或药物治疗优化干预。

主要发现

  • 提供了参与者水平治疗获益的替代定义,并总结现有及提出新的评估指标,用于评估获益的区分度、校准度和决策准确性。

关键数值与推荐

  • 原文未报告具体数值、阈值或推荐等级。

临床怎么用

  • 这些指标可用于统计和机器学习模型的性能评估,在模型开发(模型选择或内部验证)或新环境测试(外部验证)时使用,并提供R代码实现所有模型和指标。

局限性

  • 原文未报告局限性

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

Various statistical and machine learning algorithms can be used to predict treatment effects at the patient level using data from randomized clinical trials (RCTs). Such predictions can facilitate individualized treatment decisions. Recently, a range of methods and metrics were developed for assessing the accuracy of such predictions. Here, we extend these methods, focusing on the case of survival (time-to-event) outcomes. We start by providing alternative definitions of the participant-level treatment benefit; subsequently, we summarize existing and propose new measures for assessing the performance of models estimating participant-level treatment benefits. We explore metrics assessing discrimination and calibration for benefit and decision accuracy. These measures can be used to assess the performance of statistical as well as machine learning models and can be useful during model development (i.e., for model selection or for internal validation) or when testing a model in new settings (i.e., in an external validation). We illustrate methods using simulated data and real data from the OPERAM trial, an RCT in multimorbid older people, which randomized participants to either standard care or a pharmacotherapy optimization intervention. We provide R codes for implementing all models and measures.

来源:Stat Med,查看原文。版权归原作者所有。

引用

  1. Efthimiou O, Hoogland J, Debray TPA, et al. Measuring the Performance of Survival Models to Personalize Treatment Choices. Stat Med. 2025. PMID: 40207416. doi:10.1002/sim.70050

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。