危重型COVID-19预后模型的有效性存在差异:一项系统综述与外部验证
该研究系统检索Medline(截至2021年1月)中开发或更新危重型COVID-19(死亡、入住ICU和/或使用机械通气)预后模型的研究,并在两个不同背景数据集(HM,n=1,753;ICS,n=1,104)中外部验证了18个模型。九个模型区分度良好(AUC≥80%),预测死亡模型AUC为65%-87%,高于预测ICU入住或复合结局的模型(AUC 53%-78%);所有提供结局概率的模型校准均差,四个提供基于评分点的模型校准良好。结论认为仅使用常规收集预测因子的模型有效性存在差异,四个模型外部验证时区分度和校准良好并推荐使用。
要点
- 共验证18个危重型COVID-19预后模型,九个模型区分度良好(AUC≥80%)。
- 预测死亡模型AUC为65%-87%,高于预测ICU入住或复合结局的模型(AUC 53%-78%)。
- 所有提供结局概率的模型校准均差,四个提供基于评分点的模型校准良好。
核心结论
- 仅使用常规收集预测因子的危重型COVID-19预后模型有效性存在差异。
- 四个模型外部验证时区分度和校准良好,推荐使用。
研究设计与样本
- 系统综述,检索Medline(截至2021年1月)中开发或更新危重型COVID-19预后模型的研究。
- 危重型COVID-19定义为死亡、入住重症监护病房和/或住院期间使用机械通气。
- 在HM(私立西班牙医院网络,n=1,753)和ICS(公立加泰罗尼亚卫生系统,n=1,104)两个不同背景数据集中进行外部验证。
- 通过评估区分度(曲线下面积[AUC])和校准(校准图)进行验证。
主要发现
- 共验证18个预后模型。
- 九个模型区分度良好(AUC≥80%)。
- 预测死亡模型AUC为65%-87%,高于预测ICU入住或复合结局的模型(AUC 53%-78%)。
- 所有提供结局概率的模型校准均差,四个提供基于评分点的模型校准良好。
- 四个校准良好的模型以死亡为结局,预测因子包括年龄、氧饱和度和C反应蛋白。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
OBJECTIVES: To identify prognostic models which estimate the risk of critical COVID-19 in hospitalized patients and to assess their validation properties. STUDY DESIGN AND SETTING: We conducted a systematic review in Medline (up to January 2021) of studies developing or updating a model that estimated the risk of critical COVID-19, defined as death, admission to intensive care unit, and/or use of mechanical ventilation during admission. Models were validated in two datasets with different backgrounds (HM [private Spanish hospital network], n = 1,753, and ICS [public Catalan health system], n = 1,104), by assessing discrimination (area under the curve [AUC]) and calibration (plots). RESULTS: We validated 18 prognostic models. Discrimination was good in nine of them (AUCs ≥ 80%) and higher in those predicting mortality (AUCs 65%-87%) than those predicting intensive care unit admission or a composite outcome (AUCs 53%-78%). Calibration was poor in all models providing outcome's probabilities and good in four models providing a point-based score. These four models used mortality as outcome and included age, oxygen saturation, and C-reactive protein among their predictors. CONCLUSION: The validity of models predicting critical COVID-19 by using only routinely collected predictors is variable. Four models showed good discrimination and calibration when externally validated and are recommended for their use.
引用
- Cárdenas-Fuentes G, Bosch de Basea M, Cobo I, et al. Validity of prognostic models of critical COVID-19 is variable. A systematic review with external validation. J Clin Epidemiol. 2023. PMID: 37142168. doi:10.1016/j.jclinepi.2023.04.011
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。