文献速递神经技术与安全CT

众包深度学习用于颅内出血识别:群体智慧还是放任自流

Crowd-Sourced Deep Learning for Intracranial Hemorrhage Identification: Wisdom of Crowds or Laissez-Faire.
PubMed 文献 · AJNR Am J Neuroradiol · 2023-06-08

本研究回顾性纳入134例患者的去标识化临床头部CT,每层标注无颅内出血或颅内出血,用70个卷积神经网络识别,比较4种集成学习方法与单个网络的准确率及AUC。结果显示集成方法均未超过最佳单个卷积神经网络的准确率,仅1种集成方法的AUC与最佳单个网络相似(ΔAUC=0.03;95%CI,-0.01-0.06;P=0.17)。

要点

  • 集成学习未超过最佳单个卷积神经网络的准确率。
  • 单个卷积神经网络平均测试准确率67.8%(范围59.4%-76.0%)。
  • 仅1种集成方法AUC与最佳单个网络相似(ΔAUC=0.03;95%CI,-0.01-0.06;P=0.17)。

核心结论

  • 在颅内出血检测中,集成学习方法均未超过最佳单个卷积神经网络的准确率。

研究设计与样本

  • 回顾性研究,纳入134例患者的去标识化临床头部CT,每层标注无颅内出血或颅内出血,使用70个卷积神经网络识别,研究4种集成学习方法。

诊断标准与关键数值

  • 单个卷积神经网络平均测试准确率67.8%(范围59.4%-76.0%)。
  • 3种集成学习方法超过该平均测试准确率,但仅1种达到单个卷积神经网络准确率分布的第95百分位以上。
  • 仅1种集成学习方法AUC与最佳单个卷积神经网络相似(ΔAUC=0.03;95%CI,-0.01-0.06;P=0.17)。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

BACKGROUND AND PURPOSE: Researchers and clinical radiology practices are increasingly faced with the task of selecting the most accurate artificial intelligence tools from an ever-expanding range. In this study, we sought to test the utility of ensemble learning for determining the best combination from 70 models trained to identify intracranial hemorrhage. Furthermore, we investigated whether ensemble deployment is preferred to use of the single best model. It was hypothesized that any individual model in the ensemble would be outperformed by the ensemble.

MATERIALS AND METHODS: In this retrospective study, de-identified clinical head CT scans from 134 patients were included. Every section was annotated with "no-intracranial hemorrhage" or "intracranial hemorrhage," and 70 convolutional neural networks were used for their identification. Four ensemble learning methods were researched, and their accuracies as well as receiver operating characteristic curves and the corresponding areas under the curve were compared with those of individual convolutional neural networks. The areas under the curve were compared for a statistical difference using a generalized U-statistic.

RESULTS: The individual convolutional neural networks had an average test accuracy of 67.8% (range, 59.4%-76.0%). Three ensemble learning methods outperformed this average test accuracy, but only one achieved an accuracy above the 95th percentile of the individual convolutional neural network accuracy distribution. Only 1 ensemble learning method achieved a similar area under the curve as the single best convolutional neural network (Δarea under the curve = 0.03; 95% CI, -0.01-0.06; P = .17).

CONCLUSIONS: None of the ensemble learning methods outperformed the accuracy of the single best convolutional neural network, at least in the context of intracranial hemorrhage detection.

来源:AJNR Am J Neuroradiol,查看原文。版权归原作者所有。

引用

  1. Hofmeijer, Tan, van der Heijden, et al. Crowd-Sourced Deep Learning for Intracranial Hemorrhage Identification: Wisdom of Crowds or Laissez-Faire. AJNR Am J Neuroradiol. 2023. PMID: 37290819. doi:10.3174/ajnr.A7902

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。