基于注意力融合网络的多模态超声图像乳腺癌分割与分类
提出基于B模式和SE模式超声图像的多模态融合U-Net(MMF-U-Net)分割病灶,再用其编码器对裁剪图像分类良恶性;真实临床数据上分割Dice 78.23%、IoU 68.60%、精确率82.21%、召回率80.58%,分类准确率98.46%。
要点
- B模式与SE模式融合分割:Dice 78.23%、IoU 68.60%、精确率82.21%、召回率80.58%。
- 基于预训练MMF-U-Net编码器分类良恶性,准确率98.46%。
核心结论
- 所提方法能有效分割乳腺病灶区域,并可可靠区分良恶性病灶。
研究设计与样本
- 基于B模式和SE模式超声图像构建深度学习「分割+分类」模型;分割采用多模态融合U-Net(MMF-U-Net),分类使用预训练MMF-U-Net编码器;实验在真实临床数据上进行。
诊断标准与关键数值
- MMF-U-Net分割真实临床数据:Dice 78.23%、IoU 68.60%、精确率82.21%、召回率80.58%。
- 裁剪B模式与SE模式图像后分类良恶性:准确率98.46%。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
OBJECTIVE: Breast cancer is one of the most commonly occurring cancers in women. Thus, early detection and treatment of cancer lead to a better outcome for the patient. Ultrasound (US) imaging plays a crucial role in the early detection of breast cancer, providing a cost-effective, convenient, and safe diagnostic approach. To date, much research has been conducted to facilitate reliable and effective early diagnosis of breast cancer through US image analysis. Recently, with the introduction of machine learning technologies such as deep learning (DL), automated lesion segmentation and classification, the identification of malignant masses in US breasts has progressed, and computer-aided diagnosis (CAD) technology is being applied in clinics effectively. Herein, we propose a novel deep learning-based "segmentation + classification" model based on B- and SE-mode images.
METHODS: For the segmentation task, we propose a Multi-Modal Fusion U-Net (MMF-U-Net), which segments lesions by mixing B- and SE-mode information through fusion blocks. After segmenting, the lesion area from the B- and SE-mode images is cropped using a predicted segmentation mask. The encoder part of the pre-trained MMF-U-Net model is then used on the cropped B- and SE-mode breast US images to classify benign and malignant lesions.
RESULTS: The experimental results using the proposed method showed good segmentation and classification scores. The dice score, intersection over union (IoU), precision, and recall are 78.23%, 68.60%, 82.21%, and 80.58%, respectively, using the proposed MMF-U-Net on real-world clinical data. The classification accuracy is 98.46%.
CONCLUSION: Our results show that the proposed method will effectively segment the breast lesion area and can reliably classify the benign from malignant lesions.
引用
- Cho Y, Misra S, Managuli R, et al. Attention-based Fusion Network for Breast Cancer Segmentation and Classification Using Multi-modal Ultrasound Images. Ultrasound Med Biol. 2024. PMID: 39694743. doi:10.1016/j.ultrasmedbio.2024.11.020
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。