文献速递冠心病血脂与心血管预防

机器学习局部校准优化AHA-PREVENT心血管风险预测模型

Tailoring Risk Prediction Models to Local Populations.
PubMed 文献 · JAMA Cardiol · 2024-01-01

本研究基于新英格兰地区电子健康记录队列95 326例无动脉粥样硬化性心血管疾病(ASCVD)患者,采用极限梯度提升(XGBoost)机器学习模型(MLM)对AHA-PREVENT方程进行局部校准,在保留临床可解释性的同时改善校准度,并维持或提升对亚组的校准表现。

要点

  • MLM-PREVENT在亚洲、黑人和白人中维持或改善校准,区分度与AHA-PREVENT相当(ΔC指数约±0.01)。
  • 以7.5%风险阈值重新分类,MLM-PREVENT共重新分类11.5%的患者。

核心结论

  • 可解释的机器学习方法在局部人群中提升了AHA-PREVENT模型的校准准确度,同时保留了原模型的风险关联。

研究设计与样本

  • 基于新英格兰地区电子健康记录队列的回顾性队列研究,最终纳入95 326例2007年前无ASCVD且年龄<79岁的患者,数据分为训练集、测试集和验证集。

主要发现

  • MLM-PREVENT在亚洲、黑人和白人个体中维持或改善AHA-PREVENT的校准。
  • MLM-PREVENT与AHA-PREVENT的区分度表现相当(近似ΔC指数±0.01)。
  • 采用临床显著的7.5%风险阈值时,MLM-PREVENT共重新分类11.5%的患者。

关键数值与推荐

  • ASCVD事件定义为非致死性心肌梗死、冠心病、缺血性卒中或心血管死亡的首发事件。
  • 校准评估采用改良Hosmer-Lemeshow拟合优度检验和校准曲线,区分度采用Harrell C指数,重分类采用重分类表。

临床怎么用

  • 该机器学习方法可嵌入电子健康记录系统,用于局部校准现有风险预测工具,改善心血管风险评估。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

IMPORTANCE: Risk estimation is an integral part of cardiovascular care. Local recalibration of guideline-recommended models could address the limitations of existing tools. OBJECTIVE: To provide a machine learning (ML) approach to augment the performance of the American Heart Association's Predicting Risk of Cardiovascular Disease Events (AHA-PREVENT) equations when applied to a local population while preserving clinical interpretability. DESIGN, SETTING, AND PARTICIPANTS: This cohort study used a New England-based electronic health record cohort of patients without prior atherosclerotic cardiovascular disease (ASCVD) who had the data necessary to calculate the AHA-PREVENT 10-year risk of developing ASCVD in the event period (2007-2016). Patients with prior ASCVD events, death prior to 2007, or age 79 years or older in 2007 were subsequently excluded. The final study population of 95 326 patients was split into 3 nonoverlapping subsets for training, testing, and validation. The AHA-PREVENT model was adapted to this local population using the open-source ML model (MLM) Extreme Gradient Boosting model (XGBoost) with minimal predictor variables, including age, sex, and AHA-PREVENT. The MLM was monotonically constrained to preserve known associations between risk factors and ASCVD risk. Along with sex, race and ethnicity data from the electronic health record were collected to validate the performance of ASCVD risk prediction in subgroups. Data were analyzed from August 2021 to February 2024. MAIN OUTCOMES AND MEASURES: Consistent with the AHA-PREVENT model, ASCVD events were defined as the first occurrence of either nonfatal myocardial infarction, coronary artery disease, ischemic stroke, or cardiovascular death. Cardiovascular death was coded via government registries. Discrimination, calibration, and risk reclassification were assessed using the Harrell C index, a modified Hosmer-Lemeshow goodness-of-fit test and calibration curves, and reclassification tables, respectively. RESULTS: In the test set of 38 137 patients (mean [SD] age, 64.8 [6.9] years, 22 708 [59.5]% women and 15 429 [40.5%] men; 935 [2.5%] Asian, 2153 [5.6%] Black, 1414 [3.7%] Hispanic, 31 400 [82.3%] White, and 2235 [5.9%] other, including American Indian, multiple races, unspecified, and unrecorded, consolidated owing to small numbers), MLM-PREVENT had improved calibration (modified Hosmer-Lemeshow P > .05) compared to the AHA-PREVENT model across risk categories in the overall cohort (χ23 = 2.2; P = .53 vs χ23 > 16.3; P < .001) and sex subgroups (men: χ23 = 2.1; P = .55 vs χ23 > 16.3; P < .001; women: χ23 = 6.5; P = .09 vs. χ23 > 16.3; P < .001), while also surpassing a traditional recalibration approach. MLM-PREVENT maintained or improved AHA-PREVENT's calibration in Asian, Black, and White individuals. Both MLM-PREVENT and AHA-PREVENT performed equally well in discriminating risk (approximate ΔC index, ±0.01). Using a clinically significant 7.5% risk threshold, MLM-PREVENT reclassified a total of 11.5% of patients. We visualize the recalibration through MLM-PREVENT ASCVD risk charts that highlight preserved risk associations of the original AHA-PREVENT model. CONCLUSIONS AND RELEVANCE: The interpretable ML approach presented in this article enhanced the accuracy of the AHA-PREVENT model when applied to a local population while still preserving the risk associations found by the original model. This method has the potential to recalibrate other established risk tools and is implementable in electronic health record systems for improved cardiovascular risk assessment.

来源:JAMA Cardiol,查看原文。版权归原作者所有。

引用

  1. Zinzuwadia AN, Mineeva O, Li C, et al. Tailoring Risk Prediction Models to Local Populations. JAMA Cardiol. 2024. PMID: 39292486. doi:10.1001/jamacardio.2024.2912

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。