文献速递流行病学与生物统计基础与转化研究

个体参与者数据荟萃分析用于外部验证、重校准与更新灵活参数预后模型

Individual participant data meta-analysis for external validation, recalibration, and updating of a flexible parametric prognostic model.
PubMed 文献 · Stat Med · 2021-03-26

该研究探讨如何利用多来源个体参与者数据(IPD)荟萃分析对预后模型进行外部验证与重校准。研究比较了四种重校准策略,并在应用示例中发现重新估计基线风险可改善校准并减少异质性。IPD荟萃分析可比较和排序重校准策略,以选择最小干预实现可接受的外部性能。

要点

  • IPD荟萃分析可跨多人群外部验证预后模型并量化性能异质性。
  • 重校准策略包括移动基线风险、重估基线形状、调整预后指数及调整预测因子效应。
  • 可通过预测新人群表现良好的概率对重校准策略排序,选择最小干预策略。

核心结论

  • IPD荟萃分析可外部验证预后模型并比较重校准策略,选择最小干预策略实现可接受外部性能而不丢弃现有模型信息。

研究设计与样本

  • 方法学研究,利用多来源个体参与者数据(IPD)进行荟萃分析,比较四种重校准策略。
  • 应用示例中,IPD荟萃分析用于跨多人群验证现有时间至事件模型并评估重校准效果。

主要发现

  • 应用示例中现有模型在某些人群校准差且跨人群异质性大。
  • 重新估计截距可实质改善新人群的预期校准并减少人群间异质性。
  • 比较重校准策略显示,同时重新估计基线风险的大小和形状在新人群中获得良好性能的预测概率最高。

临床怎么用

  • 临床应用中可利用IPD荟萃分析对外部验证表现不佳的预后模型进行重校准,而非直接弃用。
  • 选择重校准策略时可基于新人群中获得良好性能的预测概率进行排序,优先选择最小干预策略。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

Individual participant data (IPD) from multiple sources allows external validation of a prognostic model across multiple populations. Often this reveals poor calibration, potentially causing poor predictive performance in some populations. However, rather than discarding the model outright, it may be possible to modify the model to improve performance using recalibration techniques. We use IPD meta-analysis to identify the simplest method to achieve good model performance. We examine four options for recalibrating an existing time-to-event model across multiple populations: (i) shifting the baseline hazard by a constant, (ii) re-estimating the shape of the baseline hazard, (iii) adjusting the prognostic index as a whole, and (iv) adjusting individual predictor effects. For each strategy, IPD meta-analysis examines (heterogeneity in) model performance across populations. Additionally, the probability of achieving good performance in a new population can be calculated allowing ranking of recalibration methods. In an applied example, IPD meta-analysis reveals that the existing model had poor calibration in some populations, and large heterogeneity across populations. However, re-estimation of the intercept substantially improved the expected calibration in new populations, and reduced between-population heterogeneity. Comparing recalibration strategies showed that re-estimating both the magnitude and shape of the baseline hazard gave the highest predicted probability of good performance in a new population. In conclusion, IPD meta-analysis allows a prognostic model to be externally validated in multiple settings, and enables recalibration strategies to be compared and ranked to decide on the least aggressive recalibration strategy to achieve acceptable external model performance without discarding existing model information.

来源:Stat Med,查看原文。版权归原作者所有。

引用

  1. Ensor J, Snell KIE, Debray TPA, et al. Individual participant data meta-analysis for external validation, recalibration, and updating of a flexible parametric prognostic model. Stat Med. 2021. PMID: 33768582. doi:10.1002/sim.8959

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。