文献速递神经MR

自然语言处理利用MR影像报告预测弥漫性胶质瘤异柠檬酸脱氢酶基因型

Natural language processing to predict isocitrate dehydrogenase genotype in diffuse glioma using MR radiology reports.
PubMed 文献 · Eur Radiol · 2023-08-11

这项回顾性多中心研究纳入2009年5月至2021年11月间具有已知IDH突变状态且病理诊断前有初始MR影像报告的弥漫性胶质瘤连续患者,训练五种自然语言处理模型预测IDH突变状态,并在内外验证集中评估AUC。外部验证集中BERT GCN表现最佳(AUC 0.85,95%CI 0.81-0.89),高于神经放射科医生(AUC 0.80,95%CI 0.76-0.84;p=0.005)和神经外科医生(AUC 0.79,95%CI 0.76-0.84;p=0.04)。结论认为BERT GCN在利用常规MR影像报告预测IDH突变状态方面获得外部验证,性能优于或至少不劣于人类读者。

要点

  • BERT GCN在外部验证集预测IDH突变状态的AUC为0.85(95%CI 0.81-0.89)。
  • BERT GCN外部验证AUC高于LSTM(0.77,95%CI 0.72-0.81;p=0.003)和BioBERT(0.81,95%CI 0.76-0.85;p=0.03)。
  • BERT GCN外部验证AUC高于神经放射科医生(0.80,95%CI 0.76-0.84;p=0.005)。

核心结论

  • BERT GCN经外部验证可利用常规MR影像报告预测弥漫性胶质瘤患者的IDH突变状态,性能优于或至少不劣于人类读者。

研究设计与样本

  • 回顾性多中心研究,纳入2009年5月至2021年11月间IDH突变状态已知且病理诊断前有初始MR影像报告的弥漫性胶质瘤连续患者,共1427例(平均年龄±标准差54±15岁;男性779例,占54.6%),其中训练集720例、内部验证集180例、外部验证集527例。
  • 训练五种自然语言处理模型:长短期记忆(LSTM)、双向LSTM、来自变换器的双向编码器表示(BERT)、BERT图卷积网络(GCN)、BioBERT,以内外部验证集AUC评估IDH突变状态预测性能,并将最佳模型与人类读者比较。

诊断标准与关键数值

  • 外部验证集中BERT GCN预测IDH突变状态的AUC为0.85(95%CI 0.81-0.89)。
  • 外部验证集中LSTM的AUC为0.77(95%CI 0.72-0.81),BioBERT的AUC为0.81(95%CI 0.76-0.85)。
  • 外部验证集中神经放射科医生的AUC为0.80(95%CI 0.76-0.84),神经外科医生的AUC为0.79(95%CI 0.76-0.84)。

临床应用与阅片要点

  • 自然语言处理可从常规影像报告中提取相关信息以预测癌症基因型并提供预后信息,可能有助于指导治疗策略和实现个体化医疗。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

OBJECTIVES: To evaluate the performance of natural language processing (NLP) models to predict isocitrate dehydrogenase (IDH) mutation status in diffuse glioma using routine MR radiology reports.

MATERIALS AND METHODS: This retrospective, multi-center study included consecutive patients with diffuse glioma with known IDH mutation status from May 2009 to November 2021 whose initial MR radiology report was available prior to pathologic diagnosis. Five NLP models (long short-term memory [LSTM], bidirectional LSTM, bidirectional encoder representations from transformers [BERT], BERT graph convolutional network [GCN], BioBERT) were trained, and area under the receiver operating characteristic curve (AUC) was assessed to validate prediction of IDH mutation status in the internal and external validation sets. The performance of the best performing NLP model was compared with that of the human readers.

RESULTS: A total of 1427 patients (mean age ± standard deviation, 54 ± 15; 779 men, 54.6%) with 720 patients in the training set, 180 patients in the internal validation set, and 527 patients in the external validation set were included. In the external validation set, BERT GCN showed the highest performance (AUC 0.85, 95% CI 0.81-0.89) in predicting IDH mutation status, which was higher than LSTM (AUC 0.77, 95% CI 0.72-0.81; p = .003) and BioBERT (AUC 0.81, 95% CI 0.76-0.85; p = .03). This was higher than that of a neuroradiologist (AUC 0.80, 95% CI 0.76-0.84; p = .005) and a neurosurgeon (AUC 0.79, 95% CI 0.76-0.84; p = .04).

CONCLUSION: BERT GCN was externally validated to predict IDH mutation status in patients with diffuse glioma using routine MR radiology reports with superior or at least comparable performance to human reader.

CLINICAL RELEVANCE STATEMENT: Natural language processing may be used to extract relevant information from routine radiology reports to predict cancer genotype and provide prognostic information that may aid in guiding treatment strategy and enabling personalized medicine.

KEY POINTS: • A transformer-based natural language processing (NLP) model predicted isocitrate dehydrogenase mutation status in diffuse glioma with an AUC of 0.85 in the external validation set. • The best NLP models were superior or at least comparable to human readers in both internal and external validation sets. • Transformer-based models showed higher performance than conventional NLP model such as long short-term memory.

来源:Eur Radiol,查看原文。版权归原作者所有。

引用

  1. Kim M, Ong KT, Choi S, et al. Natural language processing to predict isocitrate dehydrogenase genotype in diffuse glioma using MR radiology reports. Eur Radiol. 2023. PMID: 37566271. doi:10.1007/s00330-023-10061-z

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。