AI-ECG在社区人群中检测结构性心脏病的可迁移性与疾病谱影响:PREVUE-VALVE研究
本研究评估AI-ECG模型EchoNext在社区人群PREVUE-VALVE(65-85岁)中检测结构性心脏病(SHD)的性能,并与医院来源队列比较。社区队列SHD患病率更低(8% vs 43%)、病情更轻,模型判别能力下降(AUC 71% vs 83%),倾向性匹配后差异仍存在。提示疾病谱和临床背景影响AI模型可迁移性,应在目标使用人群中评估。
要点
- AI-ECG模型在医院队列开发后用于社区人群,判别能力明显下降。
- 社区人群SHD患病率低、病情轻且表型不同,是性能衰减的主要原因。
- 在异常心电图或健康状态受损的社区亚组中,模型性能相对较好。
核心结论
- 在患病率更低、表型更轻的社区人群中,AI-ECG检测SHD的性能较医院队列下降,差异由疾病谱驱动。
- 疾病患病率和病例组合均影响AI模型性能,强调在预期使用人群中评估模型的重要性。
研究设计与样本
- EchoNext为多中心医院队列训练用于检测SHD的AI-ECG模型。
- 在PREVUE-VALVE社区研究(65-85岁,居家ECG和经胸超声心动图)中评估性能,共3000例参与者,2402例符合分析标准。
- 采用AUC和预测值评估,并与推导及外部医院队列比较,使用倾向性匹配校正患病率和病例组合差异。
- 对临床相关人群进行亚组分析。
主要发现
- PREVUE-VALVE队列SHD患病率为8%,医院队列为43%,且疾病严重程度更轻、表型有偏移(更多中度三尖瓣反流、更少收缩性心衰)。
- 模型在PREVUE-VALVE中的判别能力低于医院队列(AUC 71% [95% CI: 66%-76%] vs 83% [95% CI: 82%-83%])。
- 倾向性匹配减弱但未消除该差异,而外部医院队列间性能相似,支持疾病谱和临床背景是关键驱动因素。
- 在SHD患病率更高、病情更重的社区亚组中性能略好,如心电图异常者(AUC 79% [95% CI: 75%-83%])或健康状态受损者(AUC 76% [95% CI: 70%-82%])。
临床怎么用
- 在社区环境中应用AI-ECG筛查SHD时,需考虑其性能可能低于医院验证结果。
- 可优先在患病率较高或病情较重的亚组(如心电图异常、健康状态受损)中使用AI-ECG辅助识别SHD。
- AI模型落地前应在目标使用人群中重新评估性能。
局限性
- 原文未明确列出局限性内容。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Artificial intelligence (AI) diagnostic models are typically developed in hospital-based populations enriched for disease prevalence and severity, where distinctions between health and disease are pronounced. When deployed in community-dwelling populations with lower prevalence and milder phenotypes, these distinctions may become less well-defined, raising questions about transportability and the impact of disease spectrum on model performance. OBJECTIVES: The purpose of this study was to evaluate how differences in disease spectrum influence the transportability of AI-based diagnostic models into community-dwelling populations, using artificial intelligence electrocardiogram analysis (AI-ECG) for structural heart disease (SHD) as a test case. METHODS: EchoNext is an AI-ECG model trained in a multicenter, hospital-based cohort to detect SHD. We evaluated its performance in PREVUE-VALVE (Age and Sex-Specific PREValence of AcqUirEd VALVular Heart DiseasE Study), a community-based study of individuals aged 65 to 85 years undergoing in-home ECG and transthoracic echocardiography. Performance was assessed using area under the receiver operating characteristic curve (AUC) and predictive value and compared with derivation and external hospital-based cohorts, using propensity matching to account for differences in disease prevalence and case mix. Subgroup analyses were performed in clinically relevant populations. RESULTS: Among 3,000 PREVUE-VALVE participants, 2,402 met criteria for analysis. Compared with hospital-based cohorts, PREVUE-VALVE had lower SHD prevalence (8% vs 43%), less severe disease, and a shift in phenotype, including more moderate tricuspid regurgitation and less systolic heart failure. Consistent with these differences, model discrimination was lower in PREVUE-VALVE than in the hospital-based cohort (AUC: 71% [95% CI: 66%-76%] vs 83% [95% CI: 82%-83%]). Propensity matching attenuated but did not eliminate this difference, while performance was similar across external hospital-based cohorts, supporting disease spectrum and clinical context as key drivers. Performance was modestly better in PREVUE-VALVE subgroups with higher SHD prevalence and greater disease severity, such as individuals with an abnormal ECG (AUC: 79% [95% CI: 75%-83%]) or impaired health status (AUC: 76% [95% CI: 70%-82%]). CONCLUSIONS: In a community-dwelling population with lower disease prevalence and milder phenotypes, AI-ECG performance was attenuated relative to hospital-based cohorts, driven by differences in disease spectrum. These findings underscore the impact of both disease prevalence and case mix on AI performance and highlight the importance of model evaluation within intended use populations. (Age and Sex-Specific PREValence if AcqUirEd VALVular Heart DiseasE; NCT05357404).
引用
- Poterucha TJ, Hughes JW, Brener MI, et al. AI-ECG Detection of Structural Heart Disease in the Community Setting: Transportability and Spectrum Effects in the PREVUE-VALVE Study. J Am Coll Cardiol. 2026. PMID: 42615442. doi:10.1016/j.jacc.2026.06.013
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。