文献速递医学人工智能与信息学流行病学与生物统计真实世界研究与卫生经济

因COVID-19住院患者临床恶化风险的早期识别:模型开发与多中心外部验证研究

Early identification of patients admitted to hospital for covid-19 at risk of clinical deterioration: model development and multisite external validation study.
PubMed 文献 · BMJ · 2022-02-17

OBJECTIVE: To create and validate a simple and transferable machine learning model from electronic health record data to accurately predict clinical deterioration in patients with covid-19 across institutions, through use of a novel paradigm for model development and code sharing…

要点

  • 模型基于电子健康记录中9个临床和个人特征变量预测入院5天内临床恶化。
  • 内部验证AUROC为0.80,12家外部医疗中心验证AUROC范围为0.77-0.84。
  • 模型分诊低风险患者早期出院可能每例最多节省7.8个床位日。

核心结论

  • 该模型在单一医院快速开发以应对COVID-19大流行,无需共享数据即可外部应用,并在多个医疗中心、患者亚组和时间段表现良好,显示其作为优化医疗资源工具的潜力。

研究设计与样本

  • 共33119名成人(≥18岁)因呼吸窘迫或COVID-19住院,模型训练基于从电子健康记录2686个变量中选出的9个临床和个人特征变量。
  • 模型为线性模型集成,预测入院前5天内临床恶化复合结局,定义为院内死亡或机械通气、加热高流量鼻导管、静脉血管升压药三种治疗中任一。

主要发现

  • 13家医疗中心共9291例COVID-19相关住院用于模型验证,其中1510例(16.3%)发生主要结局。
  • 内部验证队列AUROC为0.80(95%CI 0.77-0.84),预期校准误差为0.01(95%CI 0.00-0.02)。
  • 12家外部医疗中心验证AUROC范围为0.77-0.84,性别、年龄、种族和族裔亚组AUROC范围为0.78-0.84,各季度AUROC范围为0.73-0.83。
  • 使用模型分诊低风险患者并早期出院,可能每例最多节省7.8个床位日。

临床怎么用

  • 原文未据此给出临床推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

OBJECTIVE: To create and validate a simple and transferable machine learning model from electronic health record data to accurately predict clinical deterioration in patients with covid-19 across institutions, through use of a novel paradigm for model development and code sharing. DESIGN: Retrospective cohort study. SETTING: One US hospital during 2015-21 was used for model training and internal validation. External validation was conducted on patients admitted to hospital with covid-19 at 12 other US medical centers during 2020-21. PARTICIPANTS: 33 119 adults (≥18 years) admitted to hospital with respiratory distress or covid-19. MAIN OUTCOME MEASURES: An ensemble of linear models was trained on the development cohort to predict a composite outcome of clinical deterioration within the first five days of hospital admission, defined as in-hospital mortality or any of three treatments indicating severe illness: mechanical ventilation, heated high flow nasal cannula, or intravenous vasopressors. The model was based on nine clinical and personal characteristic variables selected from 2686 variables available in the electronic health record. Internal and external validation performance was measured using the area under the receiver operating characteristic curve (AUROC) and the expected calibration error-the difference between predicted risk and actual risk. Potential bed day savings were estimated by calculating how many bed days hospitals could save per patient if low risk patients identified by the model were discharged early. RESULTS: 9291 covid-19 related hospital admissions at 13 medical centers were used for model validation, of which 1510 (16.3%) were related to the primary outcome. When the model was applied to the internal validation cohort, it achieved an AUROC of 0.80 (95% confidence interval 0.77 to 0.84) and an expected calibration error of 0.01 (95% confidence interval 0.00 to 0.02). Performance was consistent when validated in the 12 external medical centers (AUROC range 0.77-0.84), across subgroups of sex, age, race, and ethnicity (AUROC range 0.78-0.84), and across quarters (AUROC range 0.73-0.83). Using the model to triage low risk patients could potentially save up to 7.8 bed days per patient resulting from early discharge. CONCLUSION: A model to predict clinical deterioration was developed rapidly in response to the covid-19 pandemic at a single hospital, was applied externally without the sharing of data, and performed well across multiple medical centers, patient subgroups, and time periods, showing its potential as a tool for use in optimizing healthcare resources.

来源:BMJ,查看原文。版权归原作者所有。

引用

  1. Kamran F, Tang S, Otles E, et al. Early identification of patients admitted to hospital for covid-19 at risk of clinical deterioration: model development and multisite external validation study. BMJ. 2022. PMID: 35177406. doi:10.1136/bmj-2021-068576

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。