文献速递胸部技术与安全CT

深度学习对放射学自由文本报告的分类

Deep Learning to Classify Radiology Free-Text Reports.
PubMed 文献 · Radiology · 2017-11-13

本研究比较深度学习卷积神经网络模型与传统自然语言处理模型PeFinder从两所机构的胸部CT报告中提取肺栓塞表现的效果。CNN模型准确率达99%,AUC为0.97;内部验证中CNN的F1评分(0.938)显著高于PeFinder(0.867),但敏感度、特异度、准确率无显著差异;外部验证中两模型无统计学差异。结论认为CNN可对放射学自由文本报告进行分类,准确率相当于或超过现有传统NLP模型。

要点

  • CNN模型从胸部CT报告中提取肺栓塞表现的准确率达99%,AUC为0.97。
  • 内部验证中CNN的F1评分0.938显著高于PeFinder的0.867,其余指标无显著差异。
  • 外部验证中CNN与PeFinder的表现无统计学差异。

核心结论

  • 深度学习CNN模型可对放射学自由文本报告进行分类,准确率相当于或超过现有传统NLP模型。

研究设计与样本

  • 研究类型为模型性能比较研究,比较深度学习CNN模型与开源应用PeFinder从胸部CT报告中提取肺栓塞表现的效果。
  • 数据为1998年1月1日至2016年1月1日期间进行的胸部对比剂增强CT检查报告。
  • 由两名人类放射科医生对肺栓塞的存在、慢性程度和位置三个类别进行标注。
  • CNN模型采用无监督学习算法获取词向量表示,并与PeFinder在内部验证集和外部验证集上比较。
  • 评价指标包括敏感度、特异度、准确率和F1评分。

诊断标准与关键数值

  • CNN模型准确率为99%,AUC为0.97。
  • 内部验证报告中,将表现分类为肺栓塞阳性或阴性时,CNN模型F1评分为0.938,PeFinder为0.867,CNN显著更高,但敏感度、特异度、准确率无显著差异。
  • 外部验证报告中,CNN模型与PeFinder的表现无统计学差异。

临床应用与阅片要点

  • 原文未据此给出推荐。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Purpose To evaluate the performance of a deep learning convolutional neural network (CNN) model compared with a traditional natural language processing (NLP) model in extracting pulmonary embolism (PE) findings from thoracic computed tomography (CT) reports from two institutions. Materials and Methods Contrast material-enhanced CT examinations of the chest performed between January 1, 1998, and January 1, 2016, were selected. Annotations by two human radiologists were made for three categories: the presence, chronicity, and location of PE. Classification of performance of a CNN model with an unsupervised learning algorithm for obtaining vector representations of words was compared with the open-source application PeFinder. Sensitivity, specificity, accuracy, and F1 scores for both the CNN model and PeFinder in the internal and external validation sets were determined. Results The CNN model demonstrated an accuracy of 99% and an area under the curve value of 0.97. For internal validation report data, the CNN model had a statistically significant larger F1 score (0.938) than did PeFinder (0.867) when classifying findings as either PE positive or PE negative, but no significant difference in sensitivity, specificity, or accuracy was found. For external validation report data, no statistical difference between the performance of the CNN model and PeFinder was found. Conclusion A deep learning CNN model can classify radiology free-text reports with accuracy equivalent to or beyond that of an existing traditional NLP model. © RSNA, 2017 Online supplemental material is available for this article.

来源:Radiology,查看原文。版权归原作者所有。

引用

  1. Chen MC, Ball RL, Yang L, et al. Deep Learning to Classify Radiology Free-Text Reports. Radiology. 2017. PMID: 29135365. doi:10.1148/radiol.2017171115

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。