文献速递重症综合管理与镇静镇痛消化、代谢与肾脏急症

广泛使用的专有脓毒症预测模型在住院患者中的外部验证

External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patients.
PubMed 文献 · JAMA Intern Med · 2021-01-01
一句话结论Epic脓毒症模型(ESM)外部验证区分度差(AUC 0.63),漏诊67%脓毒症患者,同时18%住院患者触发警报,造成警报疲劳。

这项回顾性队列研究在密歇根医学院27 697例患者(38 455次住院)中外部验证专有脓毒症预测模型Epic脓毒症模型(ESM),ESM每15分钟计算一次评分。脓毒症发生率为7%(2552例),ESM住院水平AUC为0.63(95%CI 0.62-0.64)。ESM仅识别183/2552例(7%)未及时接受抗生素的脓毒症患者,却漏诊1709例(67%)脓毒症患者,同时对6971/38 455例(18%)住院患者产生ESM评分≥6的警报,造成警报疲劳。作者认为ESM预测脓毒症发病区分度和校准度均差,其广泛采用引发对全国脓毒症管理的根本担忧。

要点

  • ESM住院水平AUC为0.63(95%CI 0.62-0.64),区分度差。
  • ESM仅识别183/2552例(7%)未及时接受抗生素的脓毒症患者,敏感性低。
  • ESM漏诊1709/2552例(67%)脓毒症患者,同时对6971/38 455例(18%)住院患者触发ESM评分≥6警报。
  • 脓毒症发生率7%(2552/38 455次住院),中位年龄56岁(四分位距35-69岁),女性21 904例(57%)。

适用人群与场景

  • 密歇根医学院(密歇根大学学术医疗系统)≥18岁住院患者,2018年12月6日至2019年10月20日期间38 455次住院、27 697例患者。

诊断标准与关键阈值

  • 脓毒症定义为复合标准:(1)美国疾病控制与预防中心监测标准;和(2)国际疾病分类第十版诊断代码,且伴有2项全身炎症反应综合征标准和1项器官功能障碍标准,彼此间隔6小时内。
  • ESM评分每15分钟计算一次。
  • ESM评分≥6触发警报。

研究设计与关键结果

  • 研究类型:回顾性队列研究;人群:27 697例患者、38 455次住院;脓毒症发生2552例(7%)。
  • ESM住院水平AUC 0.63(95%CI 0.62-0.64)。
  • ESM识别183/2552例(7%)脓毒症患者未及时接受抗生素。
  • ESM漏诊1709/2552例(67%)脓毒症患者;对6971/38 455例(18%)住院患者触发ESM评分≥6警报。
  • 作者结论:ESM预测脓毒症发病区分度和校准度差;其广泛采用引发对全国脓毒症管理的根本担忧。

证据类型、等级与局限

  • 证据类型:回顾性队列研究(外部验证)。
  • 局限:原文未报告局限性。

对床旁实践的改变

  • 作者认为,ESM预测脓毒症发病区分度和校准度差,其广泛采用引发对全国脓毒症管理的根本担忧。

提炼说明

  • 本条依据论文摘要整理;摘要未涉及「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开

IMPORTANCE: The Epic Sepsis Model (ESM), a proprietary sepsis prediction model, is implemented at hundreds of US hospitals. The ESM's ability to identify patients with sepsis has not been adequately evaluated despite widespread use.

OBJECTIVE: To externally validate the ESM in the prediction of sepsis and evaluate its potential clinical value compared with usual care.

DESIGN, SETTING, AND PARTICIPANTS: This retrospective cohort study was conducted among 27 697 patients aged 18 years or older admitted to Michigan Medicine, the academic health system of the University of Michigan, Ann Arbor, with 38 455 hospitalizations between December 6, 2018, and October 20, 2019.

EXPOSURE: The ESM score, calculated every 15 minutes.

MAIN OUTCOMES AND MEASURES: Sepsis, as defined by a composite of (1) the Centers for Disease Control and Prevention surveillance criteria and (2) International Statistical Classification of Diseases and Related Health Problems, Tenth Revision diagnostic codes accompanied by 2 systemic inflammatory response syndrome criteria and 1 organ dysfunction criterion within 6 hours of one another. Model discrimination was assessed using the area under the receiver operating characteristic curve at the hospitalization level and with prediction horizons of 4, 8, 12, and 24 hours. Model calibration was evaluated with calibration plots. The potential clinical benefit associated with the ESM was assessed by evaluating the added benefit of the ESM score compared with contemporary clinical practice (based on timely administration of antibiotics). Alert fatigue was evaluated by comparing the clinical value of different alerting strategies.

RESULTS: We identified 27 697 patients who had 38 455 hospitalizations (21 904 women [57%]; median age, 56 years [interquartile range, 35-69 years]) meeting inclusion criteria, of whom sepsis occurred in 2552 (7%). The ESM had a hospitalization-level area under the receiver operating characteristic curve of 0.63 (95% CI, 0.62-0.64). The ESM identified 183 of 2552 patients with sepsis (7%) who did not receive timely administration of antibiotics, highlighting the low sensitivity of the ESM in comparison with contemporary clinical practice. The ESM also did not identify 1709 patients with sepsis (67%) despite generating alerts for an ESM score of 6 or higher for 6971 of all 38 455 hospitalized patients (18%), thus creating a large burden of alert fatigue.

CONCLUSIONS AND RELEVANCE: This external validation cohort study suggests that the ESM has poor discrimination and calibration in predicting the onset of sepsis. The widespread adoption of the ESM despite its poor performance raises fundamental concerns about sepsis management on a national level.

来源:JAMA Intern Med,查看原文。版权归原作者所有。

参考来源

  1. Wong A, Otles E, Donnelly JP, et al. External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patients. JAMA Intern Med. 2021. PMID: 34152373. doi:10.1001/jamainternmed.2021.2626

供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。