文献速递妇产影像

死产预测模型的外部验证:基于IPPIC网络数据库的个体参与者数据Meta分析

External validation of prognostic models to predict stillbirth using International Prediction of Pregnancy Complications (IPPIC) Network database: individual participant data meta-analysis.
PubMed 文献 · Ultrasound Obstet Gynecol · 2022-01-01

该研究基于IPPIC网络19个队列49万余例孕妇的个体数据,对已发表的3个死产预测模型进行外部验证。结果显示模型区分度(C统计量0.53-0.65)和校准度均较差,风险预测偏极端,临床效用有限。方法学上存在过拟合等缺陷,暂不支持临床常规应用。

要点

  • 现有死产预测模型外部验证区分度差,C统计量仅0.53-0.65
  • 模型校准不佳,预测风险常偏极端,临床净获益有限
  • 模型开发存在方法学缺陷(如过拟合),需更稳健模型

核心结论

  • 三个经验证的死产预测模型在新数据中预测性能普遍较差且不确定,临床应用的证据有限。

研究设计与样本

  • 采用PROBAST评估模型与队列的偏倚风险,用C统计量评价区分度,用校准图、校准斜率及校准-in-the-large评价校准度,并用随机效应Meta分析汇总。

诊断标准与关键数值

  • 三个模型汇总C统计量范围为0.53至0.65,汇总校准斜率范围为0.40至0.88。
  • 基于PROBAST评估,三个模型开发研究总体均为高偏倚风险。
  • 风险预测与观察风险相比普遍过于极端,净获益评估显示模型几乎无临床效用。

临床应用与阅片要点

  • 目前证据不支持将这三个死产预测模型直接用于临床风险评估或指导监护决策。
  • 阅片或报告时不应依据这些模型的风险评分来建议加强监护或提前分娩。
  • 需警惕模型过拟合导致在新人群中预测效能下降,外部验证是应用前提。

局限性

  • 部分模型可用样本量小,其性能评估仍存在不确定性。
  • 仅能验证40个模型中变量可用的3个,且仅20%(8/40)的模型报告了完整模型方程。
  • 所有三个模型开发研究根据PROBAST均为高偏倚风险,存在方法学缺陷如过拟合。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVE: Stillbirth is a potentially preventable complication of pregnancy. Identifying women at high risk of stillbirth can guide decisions on the need for closer surveillance and timing of delivery in order to prevent fetal death. Prognostic models have been developed to predict the risk of stillbirth, but none has yet been validated externally. In this study, we externally validated published prediction models for stillbirth using individual participant data (IPD) meta-analysis to assess their predictive performance.

METHODS: MEDLINE, EMBASE, DH-DATA and AMED databases were searched from inception to December 2020 to identify studies reporting stillbirth prediction models. Studies that developed or updated prediction models for stillbirth for use at any time during pregnancy were included. IPD from cohorts within the International Prediction of Pregnancy Complications (IPPIC) Network were used to validate externally the identified prediction models whose individual variables were available in the IPD. The risk of bias of the models and cohorts was assessed using the Prediction study Risk Of Bias ASsessment Tool (PROBAST). The discriminative performance of the models was evaluated using the C-statistic, and calibration was assessed using calibration plots, calibration slope and calibration-in-the-large. Performance measures were estimated separately in each cohort, as well as summarized across cohorts using random-effects meta-analysis. Clinical utility was assessed using net benefit.

RESULTS: Seventeen studies reporting the development of 40 prognostic models for stillbirth were identified. None of the models had been previously validated externally, and the full model equation was reported for only one-fifth (20%, 8/40) of the models. External validation was possible for three of these models, using IPD from 19 cohorts (491 201 pregnant women) within the IPPIC Network database. Based on evaluation of the model development studies, all three models had an overall high risk of bias, according to PROBAST. In the IPD meta-analysis, the models had summary C-statistics ranging from 0.53 to 0.65 and summary calibration slopes ranging from 0.40 to 0.88, with risk predictions that were generally too extreme compared with the observed risks. The models had little to no clinical utility, as assessed by net benefit. However, there remained uncertainty in the performance of some models due to small available sample sizes.

CONCLUSIONS: The three validated stillbirth prediction models showed generally poor and uncertain predictive performance in new data, with limited evidence to support their clinical application. The findings suggest methodological shortcomings in their development, including overfitting. Further research is needed to further validate these and other models, identify stronger prognostic factors and develop more robust prediction models. © 2021 The Authors. Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of International Society of Ultrasound in Obstetrics and Gynecology.

来源:Ultrasound Obstet Gynecol,查看原文。版权归原作者所有。

引用

  1. Allotey J, Whittle R, Snell KIE, et al. External validation of prognostic models to predict stillbirth using International Prediction of Pregnancy Complications (IPPIC) Network database: individual participant data meta-analysis. Ultrasound Obstet Gynecol. 2022. PMID: 34405928. doi:10.1002/uog.23757

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。