文献速递癫痫

预测新诊断癫痫患者治疗反应的深度学习模型的开发与验证

Development and Validation of a Deep Learning Model for Predicting Treatment Response in Patients With Newly Diagnosed Epilepsy.
PubMed 文献 · JAMA Neurol · 2022-01-01

这项队列研究开发并验证了基于16项临床因素和抗癫痫发作药物信息的Transformer深度学习模型,用于预测新诊断癫痫患者首次用药的治疗成功。汇总队列模型在测试集上AUROC为0.65(95%CI 0.63-0.67),加权平衡准确率为0.62(95%CI 0.60-0.64);最大队列训练模型在外部队列中AUROC范围为0.52-0.60,加权平衡准确率范围为0.51-0.62。治疗前发作次数、精神疾病、脑电图和脑影像学发现是最重要的预测变量。

要点

  • 汇总队列训练的Transformer模型在测试集AUROC为0.65,加权平衡准确率为0.62。
  • 最大队列训练模型在外部队列中AUROC范围为0.52-0.60。
  • 治疗前发作次数、精神疾病、脑电图和脑影像学是重要预测变量。

核心结论

  • 深度学习模型展示了基于临床信息个体化预测抗癫痫发作药物反应的可行性。
  • 通过改进性能(如纳入遗传和影像数据),该模型可能辅助临床医生在首次试验中选择正确药物。

研究设计与样本

  • 这项队列研究开发并验证了一个预后模型,患者于1982年至2020年间接受治疗。
  • 所有患者随访至少1年或直至首次抗癫痫发作药物失败。
  • 考虑纳入1982年至2020年间在苏格兰、马来西亚、澳大利亚和中国的专科诊所新治疗的2404例成人癫痫患者,其中606例(25.2%)因一个或多个变量信息缺失被排除出最终队列。

主要发现

  • 最终汇总队列包括1798例成人(54.5%女性;中位年龄34岁,IQR 24-50岁)。
  • 使用汇总队列训练的Transformer模型在测试集上AUROC为0.65(95%CI 0.63-0.67),加权平衡准确率为0.62(95%CI 0.60-0.64)。
  • 仅使用最大队列训练的模型在外部队列中AUROC范围为0.52-0.60,加权平衡准确率范围为0.51-0.62。
  • 治疗前发作次数、精神疾病、脑电图和脑影像学发现是两种模型中最重要的预测临床变量。
  • 使用汇总队列开发的Transformer模型在AUROC方面优于所测试的其他5个模型中的2个。

关键数值与推荐

  • 治疗成功定义为服用第一种抗癫痫发作药物期间治疗第一年完全无癫痫发作。
  • 模型使用Transformer架构,基于16项临床因素和抗癫痫发作药物信息。
  • 评估指标包括AUROC、加权平衡准确率、敏感性和特异性,基于最佳概率截断值预测治疗成功。
  • 暴露为7种抗癫痫发作药物之一。

临床怎么用

  • 原文未据此给出推荐。

局限性

  • 606例(25.2%)因一个或多个变量信息缺失被排除出最终队列。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

原文

IMPORTANCE: Selection of antiseizure medications (ASMs) for epilepsy remains largely a trial-and-error approach. Under this approach, many patients have to endure sequential trials of ineffective treatments until the "right drugs" are prescribed. OBJECTIVE: To develop and validate a deep learning model using readily available clinical information to predict treatment success with the first ASM for individual patients. DESIGN, SETTING, AND PARTICIPANTS: This cohort study developed and validated a prognostic model. Patients were treated between 1982 and 2020. All patients were followed up for a minimum of 1 year or until failure of the first ASM. A total of 2404 adults with epilepsy newly treated at specialist clinics in Scotland, Malaysia, Australia, and China between 1982 and 2020 were considered for inclusion, of whom 606 (25.2%) were excluded from the final cohort because of missing information in 1 or more variables. EXPOSURES: One of 7 antiseizure medications. MAIN OUTCOMES AND MEASURES: With the use of the transformer model architecture on 16 clinical factors and ASM information, this cohort study first pooled all cohorts for model training and testing. The model was trained again using the largest cohort and externally validated on the other 4 cohorts. The area under the receiver operating characteristic curve (AUROC), weighted balanced accuracy, sensitivity, and specificity of the model were all assessed for predicting treatment success based on the optimal probability cutoff. Treatment success was defined as complete seizure freedom for the first year of treatment while taking the first ASM. Performance of the transformer model was compared with other machine learning models. RESULTS: The final pooled cohort included 1798 adults (54.5% female; median age, 34 years [IQR, 24-50 years]). The transformer model that was trained using the pooled cohort had an AUROC of 0.65 (95% CI, 0.63-0.67) and a weighted balanced accuracy of 0.62 (95% CI, 0.60-0.64) on the test set. The model that was trained using the largest cohort only had AUROCs ranging from 0.52 to 0.60 and a weighted balanced accuracy ranging from 0.51 to 0.62 in the external validation cohorts. Number of pretreatment seizures, presence of psychiatric disorders, electroencephalography, and brain imaging findings were the most important clinical variables for predicted outcomes in both models. The transformer model that was developed using the pooled cohort outperformed 2 of the 5 other models tested in terms of AUROC. CONCLUSIONS AND RELEVANCE: In this cohort study, a deep learning model showed the feasibility of personalized prediction of response to ASMs based on clinical information. With improvement of performance, such as by incorporating genetic and imaging data, this model may potentially assist clinicians in selecting the right drug at the first trial.

来源:JAMA Neurol,查看原文。版权归原作者所有。

引用

  1. Hakeem H, Feng W, Chen Z, et al. Development and Validation of a Deep Learning Model for Predicting Treatment Response in Patients With Newly Diagnosed Epilepsy. JAMA Neurol. 2022. PMID: 36036923. doi:10.1001/jamaneurol.2022.2514

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。