深度学习与神经科医生:接受机械取栓的大血管闭塞性卒中患者功能结局预测的比较
本观察性研究纳入222例大脑中动脉M1段闭塞并接受机械取栓的患者,采用5折交叉验证评估可解释深度学习模型基于临床变量、弥散加权成像和灌注加权成像预测3个月改良Rankin量表功能结局的性能,并在50例测试患者中与5名经验丰富的卒中神经科医生比较;结果显示模型在提供影像数据时准确率显著高于神经科医生,作者假设神经科医生借助可解释深度学习模型可能显著改善早期功能结局预测。
要点
- 基于临床变量和弥散加权成像的模型在交叉验证中取得最高的二分类预测性能(AUC 0.766 [0.727-0.803])。
- 在50例测试患者中,仅使用临床数据时模型与神经科医生的二分类预测准确率相似(60% [55.4%-64.4%] vs 60% [55.8%-64.21%])。
- 提供影像数据时,模型准确率显著优于神经科医生(72% [67.8%-76%] vs 64% [59.8%-68.4%])。
核心结论
- 作者假设,若神经科医生得到可解释深度学习模型的支持,大血管闭塞性卒中患者功能结局的早期预测可能显著改善。
研究设计与样本
- 本观察性研究纳入222例大脑中动脉M1段闭塞并接受机械取栓的患者。
- 采用5折交叉验证评估可解释深度学习模型预测3个月改良Rankin量表功能结局的性能。
- 基于50例测试患者,将模型性能与5名经验丰富的卒中神经科医生进行比较。
主要发现
- 在交叉验证中,基于临床变量和弥散加权成像的模型取得最高的二分类预测性能(AUC 0.766 [0.727-0.803])。
- 仅使用临床变量或仅使用弥散加权成像的模型性能较低。
- 添加灌注加权成像未改善结局预测。
- 在50例测试患者中,仅使用临床数据时,模型与神经科医生的二分类预测准确率相似(60% [55.4%-64.4%] vs 60% [55.8%-64.21%])。
- 提供影像数据时(单独或联合临床变量),模型准确率显著优于神经科医生(72% [67.8%-76%] vs 64% [59.8%-68.4%])。
关键数值与推荐
- 二分类功能结局定义为改良Rankin量表评分0-2 vs 3-6。
- 序数功能结局定义为改良Rankin量表评分0-6。
- 预测性能评估指标包括受试者工作特征曲线下面积和准确率(正确分类患者的百分比)。
临床怎么用
- 原文未据此给出推荐。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
原文
BACKGROUND: Despite evolving treatments, functional recovery in patients with large vessel occlusion stroke remains variable and outcome prediction challenging. Can we improve estimation of functional outcome with interpretable deep learning models using clinical and magnetic resonance imaging data? METHODS: In this observational study, we collected data of 222 patients with middle cerebral artery M1 segment occlusion who received mechanical thrombectomy. In a 5-fold cross validation, we evaluated interpretable deep learning models for predicting functional outcome in terms of modified Rankin scale at 3 months using clinical variables, diffusion weighted imaging and perfusion weighted imaging, and a combination thereof. Based on 50 test patients, we compared model performances to those of 5 experienced stroke neurologists. Prediction performance for ordinal (modified Rankin scale score, 0-6) and binary (modified Rankin scale score, 0-2 versus 3-6) functional outcome was assessed using discrimination and calibration measures like area under the receiver operating characteristic curve and accuracy (percentage of correctly classified patients). RESULTS: In the cross validation, the model based on clinical variables and diffusion weighted imaging achieved the highest binary prediction performance (area under the receiver operating characteristic curve, 0.766 [0.727-0.803]). Performance of models using clinical variables or diffusion weighted imaging only was lower. Adding perfusion weighted imaging did not improve outcome prediction. On the test set of 50 patients, binary prediction performance between model (accuracy, 60% [55.4%-64.4%]) and neurologists (accuracy, 60% [55.8%-64.21%]) was similar when using clinical data. However, models significantly outperformed neurologists when imaging data were provided, alone or in combination with clinical variables (accuracy, 72% [67.8%-76%] versus 64% [59.8%-68.4%] with clinical and imaging data). Prediction performance of neurologists with comparable experience varied strongly. CONCLUSIONS: We hypothesize that early prediction of functional outcome in large vessel occlusion stroke patients may be significantly improved if neurologists are supported by interpretable deep learning models.
引用
- Herzog L, Kook L, Hamann J, et al. Deep Learning Versus Neurologists: Functional Outcome Prediction in LVO Stroke Patients Undergoing Mechanical Thrombectomy. Stroke. 2023. PMID: 37313740. doi:10.1161/STROKEAHA.123.042496
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。