机器学习在肝硬化中预测再入院和死亡的效能低
基于北美终末期肝病研究联盟多中心队列2170例肝硬化住院患者,采用逻辑回归、核支持向量机和随机森林等人工智能技术预测出院后30天和90天再入院及死亡,各模型AUC为0.57至0.72,与出院时MELD-Na模型效能相当,提示仅凭人工智能技术难以准确预测上述结局。
要点
- 30天和90天再入院率分别为28%和47%,90天死亡率为13%。
- 30天再入院预测AUC:随机森林分类器全人群0.60,逻辑回归女性亚组0.57、男性亚组0.61。
- 死亡预测逻辑回归AUC:全人群0.67、女性亚组0.72、男性亚组0.69,与MELD-Na模型相似。
核心结论
- 尽管使用多种人工智能技术,仍难以预测肝硬化患者30天和90天再入院及死亡,人工智能模型准确性与仅用MELD-Na评分的模型相当。
研究设计与样本
- 研究基于北美终末期肝病研究联盟(NACSELD)多中心肝硬化住院患者队列,随访至出院后90天,评估再入院和死亡。
- 共纳入2170例患者(57±11岁,MELD 18±7,61%男性,79%白人,8%西班牙裔),训练逻辑回归、核支持向量机和随机森林分类器3种人工智能模型。
- 采用10折交叉验证的受试者工作特征曲线下面积(AUC)评估模型,并与出院时终末期肝病模型(MELD)比较。
主要发现
- 30天和90天再入院率分别为28%和47%,90天死亡率为13%。
- 30天再入院预测:随机森林分类器全人群AUC 0.60,逻辑回归女性亚组AUC 0.57、男性亚组AUC 0.61。
- 90天再入院预测:核支持向量机和随机森林分类器AUC最高,均为0.62;仅用女性训练模型(逻辑回归AUC 0.68)预测价值高于仅用男性训练模型(核支持向量机AUC 0.62)。
- 死亡预测:逻辑回归全人群AUC 0.67,女性亚组AUC 0.72,男性亚组AUC 0.69;MELD-Na模型AUC与人工智能模型相似。
临床怎么用
- 原文未据此给出临床推荐,仅指出需要额外的生物标志物来改善预测能力。
局限性
- 原文指出需要额外的生物标志物来改善预测能力。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
INTRODUCTION: Readmission and death in cirrhosis are common, expensive, and difficult to predict. Our aim was to evaluate the abilities of multiple artificial intelligence (AI) techniques to predict clinical outcomes based on variables collected at admission, during hospitalization, and at discharge. METHODS: We used the multicenter North American Consortium for the Study of End-Stage Liver Disease (NACSELD) cohort of cirrhotic inpatients who are followed up through 90-days postdischarge for readmission and death. We used statistical methods to select variables that are significant for readmission and death and trained 3 AI models, including logistic regression (LR), kernel support vector machine (SVM), and random forest classifiers (RFC), to predict readmission and death. We used the area under the receiver operating characteristic curve (AUC) from 10-fold crossvalidation for evaluation to compare sexes. Data were compared with model for end-stage liver disease (MELD) at discharge. RESULTS: We included 2,170 patients (57 ± 11 years, MELD 18 ± 7, 61% men, 79% White, and 8% Hispanic). The 30-day and 90-day readmission rates were 28% and 47%, respectively, and 13% died at 90 days. Prediction for 30-day readmission resulted in 0.60 AUC for all patients with RFC, 0.57 AUC with LR for women-only subpopulation, and 0.61 AUC with LR for men-only subpopulation. For 90-day readmission, the highest AUC was achieved with kernel SVM and RFC (AUC = 0.62). We observed higher predictive value when training models with only women (AUC = 0.68 LR) vs men (AUC = 0.62 kernel SVM). Prediction for death resulted in 0.67 AUC for all patients, 0.72 for women-only subpopulation, and 0.69 for men-only subpopulation, all with LR. MELD-Na model AUC was similar to those from the AI models. DISCUSSION: Despite using multiple AI techniques, it is difficult to predict 30- and 90-day readmissions and death in cirrhosis. AI model accuracies were equivalent to models generated using only MELD-Na scores. Additional biomarkers are needed to improve our predictive capability (See also the visual abstract at http://links.lww.com/AJG/B710).
引用
- Hu C, Anjur V, Saboo K, et al. Low Predictability of Readmissions and Death Using Machine Learning in Cirrhosis. Am J Gastroenterol. 2021. PMID: 33038139. doi:10.14309/ajg.0000000000000971
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。