六种COVID-19预后模型在住院、初级保健和养老院环境中对老年人群死亡风险预测的外部验证
这项回顾性外部验证研究纳入2020年3月至12月荷兰14,092例≥70岁临床或PCR确诊COVID-19的老年人,在三个住院队列、两个初级保健队列和一个养老院队列中验证六种预后模型。所有模型在老年人群中表现不佳且存在校准不良;住院环境中4C死亡率评分区分度和校准相对最好。
要点
- 六种COVID-19预后模型在≥70岁老年人群中均表现不佳且校准不良。
- 住院环境中模型校准-in-the-large范围-1.45至7.46,C统计量0.55-0.71。
- 4C死亡率评分在住院环境中区分度和校准相对最好。
核心结论
- 大多数COVID-19死亡风险预后模型在住院、初级保健和养老院环境的老年人群中表现不佳。
- 需要了解影响老年人群预测模型性能的因素,以用于大流行准备和该人群健康相关结局的可靠预后评估。
研究设计与样本
- 回顾性外部验证研究,纳入2020年3月至2020年12月荷兰14,092例≥70岁临床或聚合酶链反应确诊COVID-19的老年人。
- 验证队列包括三个住院队列(CliniCo、COVID-OLD、COVID-PREDICT)、两个初级保健队列(Julius General Practitioners Network/Academisch network huisartsgeneeskunde/Network of Academic general Practitioners、PHARMO)和一个养老院队列(YSIS)。
- 基于COVID-19预测模型的活系统综述,使用预测模型偏倚风险评估工具进行质量和偏倚风险评估,并考虑验证队列中预测因子可及性,选择六种预后模型:GAL-COVID-19死亡率模型、4C死亡率评分、国家早期预警评分2扩展模型、Xie模型、Wang临床模型和CURB65评分。
- 所有六种模型在住院队列中验证,GAL-COVID-19死亡率模型在全部三种医疗环境中验证。
- 主要结局:住院环境为院内死亡,初级保健和养老院环境为28天死亡。
主要发现
- 所有六种预后模型在老年人群队列中表现不佳且显示校准不良。
- 住院环境中,模型校准-in-the-large范围-1.45至7.46,校准斜率0.24-0.81,C统计量0.55-0.71,4C死亡率评分区分度最好且校准良好。
- GAL-COVID-19模型在不同医疗环境间性能相似,校准-in-the-large范围-2.35至-0.15提示高估,校准斜率0.24-0.81提示过拟合迹象,C统计量0.55-0.71。
关键数值与推荐
- 住院环境模型校准-in-the-large范围-1.45至7.46。
- 住院环境校准斜率0.24-0.81。
- 住院环境C统计量0.55-0.71,4C死亡率评分区分度最好且校准良好。
- GAL-COVID-19模型校准-in-the-large范围-2.35至-0.15提示高估,校准斜率0.24-0.81提示过拟合迹象,C统计量0.55-0.71。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To systematically evaluate the performance of COVID-19 prognostic models and scores for mortality risk in older populations across three health-care settings: hospitals, primary care, and nursing homes. STUDY DESIGN AND SETTING: This retrospective external validation study included 14,092 older individuals of ≥70 years of age with a clinical or polymerase chain reaction-confirmed COVID-19 diagnosis from March 2020 to December 2020. The six validation cohorts include three hospital-based (CliniCo, COVID-OLD, COVID-PREDICT), two primary care-based (Julius General Practitioners Network/Academisch network huisartsgeneeskunde/Network of Academic general Practitioners, PHARMO), and one nursing home cohort (YSIS) in the Netherlands. Based on a living systematic review of COVID-19 prediction models using Prediction model Risk Of Bias ASsessment Tool for quality and risk of bias assessment and considering predictor availability in validation cohorts, we selected six prognostic models predicting mortality risk in adults with COVID-19 infection (GAL-COVID-19 mortality, 4C Mortality Score, National Early Warning Score 2-extended model, Xie model, Wang clinical model, and CURB65 score). All six prognostic models were validated in the hospital cohorts and the GAL-COVID-19 mortality model was validated in all three healthcare settings. The primary outcome was in-hospital mortality for hospitals and 28-day mortality for primary care and nursing home settings. Model performance was evaluated in each validation cohort separately in terms of discrimination, calibration, and decision curves. An intercept update was performed in models indicating miscalibration followed by predictive performance re-evaluation. MAIN OUTCOME MEASURE: In-hospital mortality for hospitals and 28-day mortality for primary care and nursing home setting. RESULTS: All six prognostic models performed poorly and showed miscalibration in the older population cohorts. In the hospital settings, model performance ranged from calibration-in-the-large -1.45 to 7.46, calibration slopes 0.24-0.81, and C-statistic 0.55-0.71 with 4C Mortality Score performing as the most discriminative and well-calibrated model. Performance across health-care settings was similar for the GAL-COVID-19 model, with a calibration-in-the-large in the range of -2.35 to -0.15 indicating overestimation, calibration slopes of 0.24-0.81 indicating signs of overfitting, and C-statistic of 0.55-0.71. CONCLUSION: Our results show that most prognostic models for predicting mortality risk performed poorly in the older population with COVID-19, in each health-care setting: hospital, primary care, and nursing home settings. Insights into factors influencing predictive model performance in the older population are needed for pandemic preparedness and reliable prognostication of health-related outcomes in this demographic.
引用
- Zahra A, van Smeden M, Abbink EJ, et al. External validation of six COVID-19 prognostic models for predicting mortality risk in older populations in a hospital, primary care, and nursing home setting. J Clin Epidemiol. 2024. PMID: 38311188. doi:10.1016/j.jclinepi.2024.111270
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。