骨创伤患者中的慢性危重症:面向重症监护医护人员的基于人工智能的方法
研究纳入1049例骨创伤ICU患者,其中775例来自MIMIC-III数据库、274例来自两家三级医院,采用五种机器学习技术和逻辑回归建模,以MIMIC-III队列80%建模、20%内部验证,274例前瞻性患者做外部验证,用11项评价指标构建综合评分系统。eXGBM模型内部验证AUC最高,为0.979(95%CI 0.970-0.991),优于随机森林(0.957,95%CI 0.941-0.967)、支持向量机(0.911,95%CI 0.878-0.928)和逻辑回归(0.753,95%CI 0.714-0.793);eXGBM的准确度0.925、精确度0.906、召回率0.947、特异度0.902、F1评分0.926、Brier评分0.056、Log损失0.197均优于其他模型,综合评分60分最高。外部验证eXGBM的AUC为0.887(95%CI 0.863-0.917),并已开发免费网页版AI应用。作者认为该工具有助于及时识别高危患者,未来需进一步完善模型并探索整合入临床实践。
要点
- eXGBM模型内部验证AUC 0.979(95%CI 0.970-0.991),外部验证AUC 0.887(95%CI 0.863-0.917)。
- eXGBM内部验证准确度0.925、精确度0.906、召回率0.947、特异度0.902、F1评分0.926、Brier评分0.056、Log损失0.197。
- 随机森林AUC 0.957(95%CI 0.941-0.967),支持向量机0.911(95%CI 0.878-0.928),逻辑回归0.753(95%CI 0.714-0.793)。
- 综合评分系统下eXGBM得60分,随机森林52分,K近邻39分。
- 基于eXGBM的网页版AI应用已开发并可免费访问。
适用人群与场景
- ICU骨创伤患者,建模队列775例来自MIMIC-III数据库,外部验证274例来自两家三级医院的前瞻性患者。
研究设计与关键结果
- 研究类型为队列研究,共纳入1049例骨创伤ICU患者,其中775例来自MIMIC-III数据库、274例来自两家三级医院。
- 采用五种机器学习技术和逻辑回归建模,使用MIMIC-III队列80%建模、剩余20%内部验证,274例前瞻性患者外部验证;11项评价指标构建综合评分系统。
- 内部验证eXGBM的AUC为0.979(95%CI 0.970-0.991),优于随机森林0.957(95%CI 0.941-0.967)、支持向量机0.911(95%CI 0.878-0.928)和逻辑回归0.753(95%CI 0.714-0.793)。
- eXGBM内部验证准确度0.925、精确度0.906、召回率0.947、特异度0.902、F1评分0.926、Brier评分0.056、Log损失0.197,均优于其他模型。
- 综合评分系统下eXGBM得60分,随机森林52分,K近邻39分。
- 外部验证eXGBM的AUC为0.887(95%CI 0.863-0.917)。
- 基于eXGBM的网页版AI应用已开发并可免费访问。
证据类型、等级与局限
- 证据类型:队列研究(模型开发与验证研究)。
- 局限:原文未报告局限性。
对床旁实践的改变
- 作者认为该网页版AI应用有潜力通过促进对高危患者的及时干预来改善患者管理及照护。
- 作者认为未来研究应聚焦于进一步完善模型并探索将其整合入临床实践以改善该人群结局。
提炼说明
- 本条依据论文摘要整理;摘要未涉及「诊断标准与关键阈值」「处置流程与药物剂量」「红旗征与不能漏的情况」「指南或共识出处」,故未列出这些栏目;全文请点「阅读原文」。
英文原文(摘要)· 点击展开
Background: Chronic critical illness (CCI) is a serious condition characterized by a prolonged course of illness, resulting in elevated morbidity and mortality. CCI presents significant challenges for healthcare providers in intensive care units (ICUs), particularly among patients with bone trauma. Accurate prediction of CCI in this patient population is essential for effective management and intervention. This study aims to develop a web-based artificial intelligence (AI) application designed to predict CCI in ICU patients suffering from bone trauma. Methods: A cohort of 1,049 patients were included in the study, with 775 patients from the Medical Information Mart for Intensive Care III database and 274 patients from two tertiary hospitals. Five machine learning techniques and logistic regression were employed to develop the models, using 80% of the Medical Information Mart for Intensive Care III cohort. The models' internal effectiveness was evaluated using the remaining 20% of the cohort, and external validation was performed on the 274 prospective patients. Eleven evaluation metrics were used to develop a scoring system for comprehensive performance evaluation. Results: Among all the models evaluated, the eXGBoosting Machine model demonstrated the highest performance in internal validation, with an area under the curve (AUC) value of 0.979 (95%CI: 0.970-0.991). It outperformed the Random Forest model, which had an AUC of 0.957 (95%CI: 0.941-0.967), and the Support Vector Machine (SVM) model, which achieved an AUC of 0.911 (95%CI: 0.878-0.928). The Logistic Regression (LR) model had a relatively lower AUC of 0.753 (95%CI: 0.714-0.793). In terms of various evaluation metrics, including accuracy (0.925), precision (0.906), recall (0.947), specificity (0.902), F1 score (0.926), Brier score (0.056), and Log loss (0.197), the eXGBM model consistently outperformed the other models. Additionally, based on the scoring system, the eXGBM model achieved the highest prediction score of 60, followed by the Random Forest model with a score of 52 and the K-Nearest Neighbor model with a score of 39. External validation of the eXGBM model resulted in an AUC of 0.887 (95%CI: 0.863-0.917), confirming its robust performance and generalizability. A user-friendly web-based AI application based on the eXGBM model was successfully developed and was freely accessible at the Internet. Conclusions: The development of a web-based AI application utilizing the eXGBM model demonstrates a promising advancement in the prediction of CCI among ICU patients. With favorable performance in both internal and external validation, the AI application not only achieved high accuracy and reliability but also provided a user-friendly tool for clinicians. This application has the potential to enhance patient management and care by facilitating timely interventions for at-risk patients. Future research should focus on further refining the model and exploring its integration into clinical practice to improve outcomes in this patient population.
参考来源
- Wang S, Liu T, Long Z, et al. CHRONIC CRITICAL ILLNESS IN BONE TRAUMA PATIENTS: AN AI-BASED APPROACH FOR INTENSIVE CARE UNIT HEALTHCARE PROVIDERS. Shock. 2025. PMID: 39965586. doi:10.1097/SHK.0000000000002549
供执业医师抢救与诊疗参考,不替代临床判断;剂量请结合体重、肝肾功能和本院药品规格复核,以指南原文为准。