机器学习早期脓毒症识别工具临床表现特征的回顾性观察研究
该回顾性观察研究在急性照护非教学医院评估嵌入电子病历的机器学习早期脓毒症识别工具的性能与临床效用。以编码脓毒症和SEP-1严重脓毒症标准定义真阳性,工具敏感性分别为28.6%和43.6%,阳性预测值为37.9%。临床效用(真阳性且预警早于临床识别)仅2.2%和1.6%,使用该工具未改善脓毒症死亡率。作者认为真实世界测试回顾性验证模型至关重要,早期预警临床效用可能因医院脓毒症准备状态和脓毒症医嘱集采纳程度而异。
要点
- 以编码脓毒症定义真阳性,机器学习预警敏感性28.6%,阳性预测值37.9%。
- 以SEP-1严重脓毒症标准定义真阳性,预警敏感性43.6%。
- 临床效用(真阳性且预警早于临床识别)在两种定义下分别为2.2%和1.6%。
- 使用该工具未改善脓毒症死亡率。
- 作者认为真实世界测试回顾性验证模型至关重要,临床效用可能因医院脓毒症准备状态和医嘱集采纳程度而异。
适用人群与场景
- 急诊科、观察室和成人住院病房中通过临床编码或SEP-1标准诊断脓毒症/严重脓毒症的患者,以及收到机器学习高风险脓毒症预警的患者。
诊断标准与关键阈值
- 以临床编码诊断脓毒症作为真阳性定义之一,以Center for Medicare and Medicaid Services严重脓毒症和脓毒性休克管理集束(SEP-1)标准诊断严重脓毒症作为另一真阳性定义。
研究设计与关键结果
- 回顾性观察研究,在急性照护非教学医院进行,纳入急诊科、观察室和成人住院病房患者,评估嵌入电子病历的机器学习早期脓毒症识别工具。
- 以编码脓毒症定义真阳性,预警敏感性28.6%,阳性预测值37.9%;以SEP-1严重脓毒症定义真阳性,敏感性43.6%。
- 临床效用(真阳性且预警早于临床识别)在编码脓毒症和严重脓毒症定义下分别为2.2%和1.6%。
- 使用该工具未改善脓毒症死亡率。
证据类型、等级与局限
- 证据类型:回顾性观察研究。
- 局限:原文未报告局限性。
对床旁实践的改变
- 作者认为,真实世界测试回顾性验证模型至关重要;早期预警临床效用可能因医院脓毒症准备状态和脓毒症医嘱集采纳程度而异。
提炼说明
- 本条依据论文摘要整理;摘要未涉及「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开
UNLABELLED: To estimate performance characteristics and impact on care processes of a machine learning, early sepsis recognition tool embedded in the electronic medical record.
DESIGN: Retrospective review of electronic medical records and outcomes to determine sepsis prevalence among patients about whom a warning was received in real time and timing of that warning compared with clinician recognition of potential sepsis as determined by actions documented in the electronic medical record.
SETTING: Acute care, nonteaching hospital.
PATIENTS: Patients in the emergency department, observation unit, and adult inpatient care units who had sepsis diagnosed either by clinical codes or by Center for Medicare and Medicaid Services Severe Sepsis and Septic Shock: Management Bundle (SEP-1) criteria for severe sepsis and patients who had machine learning-generated advisories about a high risk of sepsis.
INTERVENTIONS: Noninterventional study.
MEASUREMENTS AND MAIN RESULTS: Using two different definitions of sepsis as "true" sepsis, we measured the sensitivity and early warning clinical utility. Using coded sepsis to define true positives, we measured the positive predictive value of the early warnings. Sensitivity was 28.6% and 43.6% for coded sepsis and severe sepsis, respectively. The positive predictive value of an alert was 37.9% for coded sepsis. Clinical utility (true positive and earlier advisory than clinical recognition) was 2.2% and 1.6% for the two different definitions of sepsis. Use of the tool did not improve sepsis mortality rates.
CONCLUSIONS: Performance characteristics were different than previously described in this retrospective assessment of real-time warnings. Real-world testing of retrospectively validated models is essential. The early warning clinical utility may vary depending on a hospital's state of sepsis readiness and embrace of sepsis order bundles.
参考来源
- Topiwala R, Patel K, Twigg J, et al. Retrospective Observational Study of the Clinical Performance Characteristics of a Machine Learning Approach to Early Sepsis Identification. Crit Care Explor. 2019. PMID: 32166288. doi:10.1097/CCE.0000000000000046
供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。