FBN:利用在线前景与背景优化的弱监督甲状腺结节分割
本研究提出一种基于前景-背景对(FB-Pair)表示的弱监督语义分割方法,仅使用分类数据训练甲状腺结节超声图像分割模型,并通过FB-Pair生成的自监督任务修正类激活图。在甲状腺结节超声图像数据集上的实验显示,该方法的分割平均交并比(mIoU)较第二优方法提升5.7%,良恶性结节分割性能差异缩小至2.9%。
要点
- 仅用分类数据即可训练甲状腺结节超声分割模型,降低像素级标注需求。
- FB-Pair方法使分割mIoU较第二优方法提升5.7%。
- 良性与恶性结节的分割性能差异缩小至2.9%。
核心结论
- 仅使用分类数据即可在甲状腺结节超声图像上训练出性能良好的分割模型,且类激活图能更充分利用图像信息以更准确突出目标区域,从而提升分割性能。
研究设计与样本
- 方法学研究,在甲状腺结节超声图像(TUI)数据集上进行实验,比较所提方法与现有方法的分割性能。
诊断标准与关键数值
- 分割性能以平均交并比(mIoU)评估:所提方法较第二优方法提升5.7%。
- 良性结节与恶性结节的分割性能差异降低至2.9%。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVE: The main objective of the work described here was to train a semantic segmentation model using classification data for thyroid nodule ultrasound images to reduce the pressure of obtaining pixel-level labeled data sets. Furthermore, we improved the segmentation performance of the model by mining the image information to narrow the gap between weakly supervised semantic segmentation (WSSS) and fully supervised semantic segmentation.
METHODS: Most WSSS methods use a class activation map (CAM) to generate segmentation results. However, the lack of supervision information makes it difficult for a CAM to highlight the object region completely. Therefore, we here propose a novel foreground and background pair (FB-Pair) representation method, which consists of high- and low-response regions highlighted by the original CAM-generated online in the original image. During training, the original CAM is revised using the CAM generated by the FB-Pair. In addition, we design a self-supervised learning pretext task based on FB-Pair, which requires the model to predict whether the pixels in FB-Pair are from the original image during training. After this task, the model will accurately distinguish between different categories of objects.
RESULTS: Experiments on the thyroid nodule ultrasound image (TUI) data set revealed that our proposed method outperformed existing methods, with a 5.7% improvement in the mean intersection-over-union (mIoU) performance of segmentation compared with the second-best method and a reduction to 2.9% in the difference between the performance of benign and malignant nodules.
CONCLUSION: Our method trains a well-performing segmentation model on ultrasound images of thyroid nodules using only classification data. In addition, we determined that CAM can take full advantage of the information in the images to highlight the target regions more accurately and thus improve the segmentation performance.
引用
- Yu, Yan, Gao, et al. FBN: Weakly Supervised Thyroid Nodule Segmentation Optimized by Online Foreground and Background. Ultrasound Med Biol. 2023. PMID: 37308370. doi:10.1016/j.ultrasmedbio.2023.04.009
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。