DELR-Net:一种用于更轻量应用场景的3D多模态医学图像配准网络
本研究设计了一种双编码器更轻量配准网络DELR-Net,整合Mamba与ConvNet,以状态空间序列模块和动态大核块为主要组件。在3D脑部MR图像及腹部MR与CT图像上实验显示,DELR-Net在保持较低参数量的同时取得优于现有配准方法的配准结果,并在其他模态的泛化实验中表现出更优的泛化能力。
要点
- DELR-Net在3D脑部MR及腹部MR与CT图像上配准结果优于现有方法,且参数量更低。
- 网络整合Mamba与ConvNet,双编码器主成分为状态空间序列模块和动态大核块。
- 在其他模态的泛化实验中,DELR-Net表现出更优的泛化能力。
核心结论
- DELR-Net显著改善了3D多模态医学图像可变形配准的局限性,以更少参数取得更优配准性能。
研究设计与样本
- 研究设计为配准网络开发与实验评估,设计双编码器更轻量配准网络DELR-Net。
- 实验数据包括3D脑部MR图像以及腹部MR与CT图像。
- 网络以状态空间序列模块和动态大核块作为双编码器主要组件,动态特征融合块作为解码器主要组件。
局限性
- 原文未报告局限性。
以上解读依据论文摘要(全文未开放获取或许可不允许翻译转载)。
英文原文(摘要)· 点击展开
PURPOSE: 3D multimodal medical image deformable registration plays a significant role in medical image analysis and diagnosis. However, due to the substantial differences between images of different modalities, registration is challenging and requires high computational costs. Deep learning-based registration methods face these challenges. The primary aim of this paper is to design a 3D multimodal registration network that ensures high-quality registration results while reducing the number of parameters.
METHODS: This study designed a Dual-Encoder More Lightweight Registration Network (DELR-Net). DELR-Net is a low-complexity network that integrates Mamba and ConvNet. The State Space Sequence Module and the Dynamic Large Kernel block are used as the main components of the dual encoders, while the Dynamic Feature Fusion block is used as the main component of the decoder.
RESULTS: This study conducted experiments on 3D brain MR images and abdominal MR and CT images. Compared to existing registration methods, DELR-Net achieved better registration results while maintaining a lower number of parameters. Additionally, generalization experiments on other modalities showed that DELR-Net has superior generalization capabilities.
CONCLUSION: DELR-Net significantly improves the limitations of 3D multimodal medical image deformable registration, achieving better registration performance with fewer parameters.
引用
- Deng L, Lan Q, Yang X, et al. DELR-Net: a network for 3D multimodal medical image registration in more lightweight application scenarios. Abdom Radiol (NY). 2024. PMID: 39400589. doi:10.1007/s00261-024-04602-3
供执业医师工作参考,不替代临床判断;数值与分级以指南原文为准。