DI-Unet: Dimensional interaction self-attention for medical image segmentation. (September 2022)

• Record Type: Journal Article
• Authors: Wu, Yanlin; Wang, Guanglei; Wang, Zhongyang; Wang, Hongrui; Li, Yan
• Is Part Of: Biomedical signal processing and control. Volume 78(2022)
• Publication Date: 2022-09
• Subjects: Unet -- Self-attention -- Transformer -- Medical image segmentation; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.103896
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: Proposes DI-Unet, which develops Dimensional Interactive (DI) self-attention for effective feature extraction processing. When inputting high - resolution images, it can effectively reduce the amount of model calculations and capture cross-dimensional information before calculating attention weights. The overwhelming superiority of DI-Unet is demonstrated by extensive experiments in multiple databases. In large datasets, the performance of DI-Unet is better than Swin-Unet and convolutional neural networks. Provides a research foundation and important reference value for the research and application of Transformer structure in medical image segmentation tasks. Abstract: In recent years, Unet network based on convolution has become a general structure for medical image segmentation tasks. However, it cannot effectively model the long-distance dependence between features due to the limitation of the receptive field. The successful application of Transformer in computer vision solves the problem of the limited receptive field of neural networks. However, the computational complexity limits its further application in medical image segmentation. In addition, the self attention mechanism in Transformer only explores the spatial dimension relationship of the feature maps, and lacks the interaction with the channel dimension, which limits the performance improvement of the network. Here, we proposes DI-Unet, which develops Dimensional Interactive (DI) self-attention for effective feature extraction processing. When inputting high - resolution images, it can effectively reduce the amount of model calculations and capture cross-dimensional information before calculating attention weights. The overwhelming superiority of DI-Unet is demonstrated by extensive experiments in multiple databases. In large datasets, the proposed method outperforms other methods in segmentation tasks. The study provides a research foundation and important reference value for the research and application of Transformer structure in medical image segmentation tasks.