文献速递妇产影像技术与安全US

基于决策融合的卷积神经网络胎儿超声图像切面分类

Decision Fusion-Based Fetal Ultrasound Image Plane Classification Using Convolutional Neural Networks.
PubMed 文献 · Ultrasound Med Biol · 2019-02-27

该研究提出一种融合局部裁剪区域与全图特征的决策融合方法,对二维胎儿超声图像中14种胎儿结构进行自动分类,在4074张图像(训练3109张、测试965张)上平均准确率97.05%、平均精确率76.47%、平均召回率75.41%,Cohen κ为0.72,优于非融合方法(p < 0.05),对无超声扫描仪叠加信息的图像平均准确率92%。

要点

  • 融合全图与局部裁剪区域决策可自动分类14种胎儿结构,平均准确率97.05%。
  • 对无超声扫描仪叠加信息的图像平均准确率为92%。
  • 该方法可对图像中胎儿结构进行定位。

核心结论

  • 融合全图与局部裁剪区域特征的决策融合方法可自动分类14种胎儿结构,平均准确率97.05%,且优于非融合方法(p < 0.05)。

研究设计与样本

  • 研究论文;使用4074张二维胎儿超声图像(训练集3109张、测试集965张),通过微调预训练卷积神经网络训练两个特征提取器,分别基于全图和胎儿结构判别区域。

诊断标准与关键数值

  • 平均准确率97.05%、平均精确率76.47%、平均召回率75.41%,Cohen κ为0.72;对无超声扫描仪叠加信息的图像平均准确率92%;与非融合方法比较差异有统计学意义(p < 0.05)。

临床应用与阅片要点

  • 该方法可用于临床研究中回顾性分类任何超声图像,并可利用分类结果定位图像中的胎儿结构。

局限性

  • 原文未报告局限性。

以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。

英文原文(摘要)· 点击展开

Machine learning for ultrasound image analysis and interpretation can be helpful in automated image classification in large-scale retrospective analyses to objectively derive new indicators of abnormal fetal development that are embedded in ultrasound images. Current approaches to automatic classification are limited to the use of either image patches (cropped images) or the global (whole) image. As many fetal organs have similar visual features, cropped images can misclassify certain structures such as the kidneys and abdomen. Also, the whole image does not encode sufficient local information about structures to identify different structures in different locations. Here we propose a method to automatically classify 14 different fetal structures in 2-D fetal ultrasound images by fusing information from both cropped regions of fetal structures and the whole image. Our method trains two feature extractors by fine-tuning pre-trained convolutional neural networks with the whole ultrasound fetal images and the discriminant regions of the fetal structures found in the whole image. The novelty of our method is in integrating the classification decisions made from the global and local features without relying on priors. In addition, our method can use the classification outcome to localize the fetal structures in the image. Our experiments on a data set of 4074 2-D ultrasound images (training: 3109, test: 965) achieved a mean accuracy of 97.05%, mean precision of 76.47% and mean recall of 75.41%. The Cohen κ of 0.72 revealed the highest agreement between the ground truth and the proposed method. The superiority of the proposed method over the other non-fusion-based methods is statistically significant (p < 0.05). We found that our method is capable of predicting images without ultrasound scanner overlays with a mean accuracy of 92%. The proposed method can be leveraged to retrospectively classify any ultrasound images in clinical research.

来源:Ultrasound Med Biol,查看原文。版权归原作者所有。

引用

  1. Sridar P, Kumar A, Quinton A, et al. Decision Fusion-Based Fetal Ultrasound Image Plane Classification Using Convolutional Neural Networks. Ultrasound Med Biol. 2019. PMID: 30826153. doi:10.1016/j.ultrasmedbio.2018.11.016

供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。