一种基于人群的重新校准方法用于更新英国和中国心血管风险预测的生存神经网络模型
研究提出一种基于人群汇总数据的重新校准方法,用于调整生存神经网络(SNN)模型在不同人群中的心血管疾病(CVD)风险预测。利用英国生物银行(UKB)347,206人训练和内部验证,中国鄞州电子健康记录(CHERRY)队列177,756人外部验证。SNN模型区分度良好(C指数>0.720),但对中国人群风险低估60%;基于人群的重新校准方法大幅纠正低估,观察与预期(O:E)比为1.080、1.115、1.153,与基于个体数据的校准方法效果相当。
要点
- SNN模型在UKB和CHERRY验证集中C指数均>0.720,区分度稳健。
- SNN模型对中国CHERRY人群10年CVD风险低估60%。
- 基于人群汇总数据的重新校准使O:E比达1.080、1.115、1.153,与基于个体数据方法相当。
核心结论
- 所提出的基于人群汇总数据的重新校准方法无需修改原始网络即可有效调整SNN模型预测,对机器学习模型应用于不同人群至关重要。
研究设计与样本
- 研究为模型开发与验证研究,使用UKB 347,206名40-74岁无既往CVD个体进行模型训练和内部验证,CHERRY队列177,756人进行外部验证。
- 开发了三种SNN模型(DeepSurv、年龄特异性DeepSurv和DeepHit)用于10年CVD风险预测,并与Cox模型比较。
主要发现
- 所有SNN模型在UKB和CHERRY验证集中C指数均>0.720,但对CHERRY人群风险低估60%。
- 基于人群的重新校准后,DeepSurv、年龄特异性DeepSurv和DeepHit的O:E比分别为1.080、1.115和1.153。
- 基于个体数据的重新校准方法O:E比:DeepSurv为1.040,年龄特异性DeepSurv为1.054。
- 校准良好的年龄特异性DeepSurv和Cox模型识别的高风险组特征不同,女性重叠79%,男性重叠63%。
临床怎么用
- 作者认为,所提出的方法利用人群水平汇总数据有效调整SNN模型预测,无需修改原始网络,使重新校准成为将机器学习模型应用于不同人群的必要步骤。
- 作者指出,该方法凸显了SNN模型在不同地区更广泛应用的临床潜力。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: Machine learning algorithms, particularly survival neural networks (SNNs), promise to improve cardiovascular disease (CVD) risk prediction. However, the necessity and approach for recalibrating SNN models across diverse populations remain unclear. We aimed to propose a population-based recalibration method and validate it using two large cohort studies. STUDY DESIGN AND SETTING: A total of 347,206 individuals aged 40-74 years without prior CVD from UK Biobank (UKB) were for model training and internal validation and 177,756 individuals from a Chinese cohort study (CHinese Electronic health Records Research in Yinzhou [CHERRY]) were for external validation. Three types of SNN models (DeepSurv, age-specific DeepSurv, and DeepHit) were developed for the 10-year CVD risk prediction and compared to Cox models. These models were recalibrated using the proposed method to adjust for differences in disease incidence between populations based on population-level summarized data, and compared with a traditional method that used individual-level data. RESULTS: All SNN models demonstrated robust discrimination in both UKB and CHERRY validation sets (C-indices>0.720), but underpredicted risk for CHERRY populations by 60%. The population-based recalibration method largely corrected the initial risk underestimation, yielding observed-to-expected (O:E) ratios of 1.080, 1.115, and 1.153 for recalibrated DeepSurv, age-specific DeepSurv, and DeepHit, achieving comparable calibration to individual-based recalibration method (O:E ratios: 1.040, 1.054 for DeepSurv and age-specific DeepSurv). The well-calibrated age-specific DeepSurv and Cox models identified high-risk groups with distinct characteristics, with 79% overlap for women and 63% for men. CONCLUSION: The proposed method effectively adjusts predictions for survival neural network models using population-level summarized data without modifying the original network, making recalibration essential for applying machine learning models to different populations. The method highlights the clinical potential of SNN models for broader application across diverse regions. PLAIN LANGUAGE SUMMARY: Machine learning, particularly neural networks for survival analysis, shows great potential in disease risk prediction but typically requires adjustments, or "recalibration" for diverse populations. We proposed a recalibration method using population-level summarized data, rather than individual data, which is often hard to obtain. We derived several survival neural network models for 10-year cardiovascular disease risk prediction in the UK Biobank and validated them in the CHinese Electronic health Records Research in Yinzhou (CHERRY) cohort. Although the models ranked individual risk effectively, they underpredicted actual risk in the Chinese population. The proposed method successfully corrected this underprediction, aligning model outputs with observed risk. This method works for different types of survival neural network models and preserves the original model structure. This advancement enhances the reliability and generalizability of survival neural network models across regions, underscoring the need for model evaluation and recalibration before applying them to new populations. It offers a practical solution for improving their accuracy without needing detailed individual data, thus broadening the clinical application of survival neural network models in disease prevention.
引用
- Liu X, Zhang J, Liu L, et al. A population-based recalibration method for updating survival neural networks models for cardiovascular risk prediction in United Kingdom and China. J Clin Epidemiol. 2025. PMID: 40602627. doi:10.1016/j.jclinepi.2025.111895
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。