文献速递重症综合管理与镇静镇痛

普通病房恶化指数在不同医疗系统间的外部验证与比较

External Validation and Comparison of a General Ward Deterioration Index Between Diversely Different Health Systems.
PubMed 文献 · Crit Care Med · 2023-03-16
一句话结论PICTURE恶化指数在两家患者构成差异显著的医院普通病房中表现一致(AUROC 0.870与0.875),优于Epic恶化指数和NEWS。

本研究利用回顾性数据,将单中心开发的普通病房恶化指数PICTURE(基于实验室值和生命体征等结构化电子健康记录数据)应用于另一家社区医院的11,083例普通病房就诊。尽管两院在缺失率(52个特征中9个差异>5%)、恶化率(4.5% vs 2.5%)和种族构成(非白人20% vs 49%)上存在显著差异,PICTURE性能一致:第一医院AUROC 0.870(95%CI 0.861-0.878)、AUPRC 0.298(0.275-0.320);第二医院AUROC 0.875(0.851-0.902)、AUPRC 0.339(0.281-0.398),AUPRC标准化至2.5%事件率。PICTURE在两院均优于Epic恶化指数和NEWS。

要点

  • PICTURE在第二家社区医院11,083例普通病房就诊中AUROC 0.875(0.851-0.902)、AUPRC 0.339(0.281-0.398),与开发医院AUROC 0.870(0.861-0.878)、AUPRC 0.298(0.275-0.320)一致。
  • 两院恶化率不同(4.5% vs 2.5%),AUPRC已标准化至2.5%事件率以便比较。
  • PICTURE在两院均优于Epic恶化指数和NEWS。
  • 两院52个特征中9个缺失率差异>5%,种族构成非白人20% vs 49%,但模型性能未受明显影响。

适用人群与场景

  • 两家大型医院(一家学术医学中心、一家社区医院)的普通病房就诊患者;开发队列为165,018例普通病房就诊,外部验证队列为11,083例社区医院普通病房就诊。

研究设计与关键结果

  • 研究类型:外部验证与比较研究,使用回顾性数据;PICTURE为在单家学术医学中心开发的普通病房恶化指数,基于实验室值和生命体征等结构化电子健康记录数据。
  • 两院差异:52个特征中9个缺失率差异>5%;恶化率4.5% vs 2.5%;种族构成非白人20% vs 49%。
  • 第一医院(学术医学中心):AUROC 0.870(95%CI 0.861-0.878),AUPRC 0.298(95%CI 0.275-0.320)。
  • 第二医院(社区医院):AUROC 0.875(95%CI 0.851-0.902),AUPRC 0.339(95%CI 0.281-0.398)。
  • AUPRC标准化至2.5%事件率。
  • PICTURE在两院均优于Epic恶化指数和NEWS。

证据类型、等级与局限

  • 证据类型:回顾性外部验证研究;局限:原文未报告局限性。

对床旁实践的改变

  • 作者认为,PICTURE能在患者构成和数据可得性显著不同的两家医院普通病房中一致地识别有恶化风险的患者,且性能优于现有指标。

提炼说明

  • 本条依据论文摘要整理;摘要未涉及「诊断标准与关键阈值」「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开

OBJECTIVES: Implementing a predictive analytic model in a new clinical environment is fraught with challenges. Dataset shifts such as differences in clinical practice, new data acquisition devices, or changes in the electronic health record (EHR) implementation mean that the input data seen by a model can differ significantly from the data it was trained on. Validating models at multiple institutions is therefore critical. Here, using retrospective data, we demonstrate how Predicting Intensive Care Transfers and other UnfoReseen Events (PICTURE), a deterioration index developed at a single academic medical center, generalizes to a second institution with significantly different patient population.

DESIGN: PICTURE is a deterioration index designed for the general ward, which uses structured EHR data such as laboratory values and vital signs.

SETTING: The general wards of two large hospitals, one an academic medical center and the other a community hospital.

SUBJECTS: The model has previously been trained and validated on a cohort of 165,018 general ward encounters from a large academic medical center. Here, we apply this model to 11,083 encounters from a separate community hospital.

INTERVENTIONS: None.

MEASUREMENTS AND MAIN RESULTS: The hospitals were found to have significant differences in missingness rates (> 5% difference in 9/52 features), deterioration rate (4.5% vs 2.5%), and racial makeup (20% non-White vs 49% non-White). Despite these differences, PICTURE's performance was consistent (area under the receiver operating characteristic curve [AUROC], 0.870; 95% CI, 0.861-0.878), area under the precision-recall curve (AUPRC, 0.298; 95% CI, 0.275-0.320) at the first hospital; AUROC 0.875 (0.851-0.902), AUPRC 0.339 (0.281-0.398) at the second. AUPRC was standardized to a 2.5% event rate. PICTURE also outperformed both the Epic Deterioration Index and the National Early Warning Score at both institutions.

CONCLUSIONS: Important differences were observed between the two institutions, including data availability and demographic makeup. PICTURE was able to identify general ward patients at risk of deterioration at both hospitals with consistent performance (AUROC and AUPRC) and compared favorably to existing metrics.

来源:Crit Care Med,查看原文。版权归原作者所有。

参考来源

  1. Cummings BC, Blackmer JM, Motyka JR, et al. External Validation and Comparison of a General Ward Deterioration Index Between Diversely Different Health Systems. Crit Care Med. 2023. PMID: 36927631. doi:10.1097/CCM.0000000000005837

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。