用于识别手术部位感染的可解释长短期记忆网络
本研究从犹他大学健康系统电子健康记录中随机选取2016年1月至2021年6月的手术事件,训练长短期记忆网络(LSTM)并与传统机器学习模型比较,用于识别术后30天内的手术部位感染(SSI)。9,185例手术事件中SSI发生率为4.7%;LSTM的受试者工作特征曲线下面积(AUC)为0.954、敏感度为0.920,高于最佳传统模型的AUC 0.937、敏感度0.736。作者认为可解释的深度学习有望替代繁琐的人工病历审查。
要点
- 在9,185例手术事件中,手术部位感染(SSI)发生率为4.7%。
- LSTM的AUC为0.954、敏感度为0.920,最佳传统模型AUC为0.937、敏感度为0.736。
- LSTM排名前5的特征包括2个操作编码和3个实验室值。
核心结论
- 可解释的长短期记忆网络(LSTM)与传统机器学习方法相比,取得了相当的受试者工作特征曲线下面积(AUC)和更高的敏感度。
- 作者认为,借助可解释的深度学习,自动化手术部位感染监测可能替代繁琐的人工病历审查流程。
研究设计与样本
- 从犹他大学健康系统电子健康记录中检索2016年1月至2021年6月随机选取进行人工病历审查的手术事件的结构化数据和临床记录。
- 手术部位感染按国家手术质量改进计划(National Surgical Quality Improvement Program)定义确定为术后30天内发生。
- 训练长短期记忆网络(LSTM)模型,并与传统机器学习模型比较;从留出测试集计算多项性能指标,并进行可解释性分析。
主要发现
- 9,185例手术事件中,手术部位感染发生率为4.7%。
- LSTM的受试者工作特征曲线下面积(AUC)为0.954、敏感度为0.920。
- 最佳传统模型的AUC为0.937、敏感度为0.736,LSTM的AUC和敏感度均更高。
- LSTM排名前5的特征包括2个操作编码和3个实验室值。
关键数值与推荐
- 手术部位感染定义为术后30天内发生,依据国家手术质量改进计划(National Surgical Quality Improvement Program)定义判定。
- LSTM的AUC为0.954、敏感度为0.920;最佳传统模型的AUC为0.937、敏感度为0.736。
临床怎么用
- 作者认为,借助可解释的深度学习,自动化手术部位感染监测可能替代繁琐的人工病历审查流程。
局限性
- 原文未报告局限性
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Currently, surgical site infection surveillance relies on labor-intensive manual chart review. Recently suggested solutions involve machine learning to identify surgical site infections directly from the medical record. Deep learning is a form of machine learning that has historically performed better than traditional methods while being harder to interpret. We propose a deep learning model, a long short-term memory network, for the identification of surgical site infection from the medical record with an attention layer for explainability. METHODS: We retrieved structured data and clinical notes from the University of Utah Health System's electronic health care record for operative events randomly selected for manual chart review from January 2016 to June 2021. Surgical site infection occurring within 30 days of surgery was determined according to the National Surgical Quality Improvement Program definition. We trained the long short-term memory model along with traditional machine learning models for comparison. We calculated several performance metrics from a holdout test set and performed additional analyses to understand the performance of the long short-term memory, including an explainability analysis. RESULTS: Surgical site infection was present in 4.7% of the total 9,185 operative events. The area under the receiver operating characteristic curve and sensitivity of the long short-term memory was higher (area under the receiver operating characteristic curve: 0.954, sensitivity: 0.920) compared to the top traditional model (area under the receiver operating characteristic curve: 0.937, sensitivity: 0.736). The top 5 features of the long short-term memory included 2 procedure codes and 3 laboratory values. CONCLUSION: Surgical site infection surveillance is vital for the reduction of surgical site infection rates. Our explainable long short-term memory achieved a comparable area under the receiver operating characteristic curve and greater sensitivity when compared to traditional machine learning methods. With explainable deep learning, automated surgical site infection surveillance could replace burdensome manual chart review processes.
引用
- Kiser AC, Shi J, Bucher BT, et al. An explainable long short-term memory network for surgical site infection identification. Surgery. 2024. PMID: 38616153. doi:10.1016/j.surg.2024.03.006
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。