RSU-Net: U-net based on residual and self-attention mechanism in the segmentation of cardiac magnetic resonance images. (April 2023)

• Record Type: Journal Article
• Authors: Li, Yuan-Zhe; Wang, Yi; Huang, Yin-Hui; Xiang, Ping; Liu, Wen-Xi; Lai, Qing-Quan; Gao, Yi-Yuan; Xu, Mao-Sheng; Guo, Yi-Fan
• Is Part Of: Computer methods and programs in biomedicine. Volume 231(2023)
• Publication Date: 2023-04
• Subjects: U-net -- Residual -- Self-attention -- Image segmentation -- Cardiac MRI -- Deep learning; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2023.107437
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: Two skip connections are introduced inside the Conv_Connet module, which combines the original input of the module with the output after feature extraction to enhance the transfer of image feature information. A self-attention mechanism is introduced into the self-attention module at the bottom to integrate the input with global information. Combine the advantages of CrossEntropyLoss and Dice loss function, improve the loss function of the model, and use the fusion loss function to improve the training efficiency and segmentation accuracy of the network. Abstract: Background: Automated segmentation techniques for cardiac magnetic resonance imaging (MRI) are beneficial for evaluating cardiac functional parameters in clinical diagnosis. However, due to the characteristics of unclear image boundaries and anisotropic resolution anisotropy produced by cardiac magnetic resonance imaging technology, most of the existing methods still have the problems of intra-class uncertainty and inter-class uncertainty. However, due to the irregularity of the anatomical shape of the heart and the inhomogeneity of tissue density, the boundaries of its anatomical structures become uncertain and discontinuous. Therefore, fast and accurate segmentation of cardiac tissue remains a challenging problem in medical image processing. Methodology: We collected cardiac MRI data from 195 patients as training set and 35patients from different medical centers as external validation set. Our research proposed a U-net network architecture with residual connections and a self-attentive mechanism (Residual Self-Attention U-net, RSU-Net). The network relies on the classic U-net network, adopts the U-shaped symmetric architecture of the encoding and decoding mode, improves the convolution module in the network, introduces skip connections, and improves the network's capacity for feature extraction. Then for solving locality defects of ordinary convolutional networks. To achieve a global receptive field, a self-attention mechanism is introduced at the bottom of the model. The loss function employs a combination of Cross Entropy Loss and Dice Loss to jointly guide network training, resulting in more stable network training. Results: In our study, we employ the Hausdorff distance (HD) and the Dice similarity coefficient (DSC) as metrics for assessing segmentation outcomes. Comparsion was made with the segmentation frameworks of other papers, and the comparison results prove that our RSU-Net network performs better and can make accurate segmentation of the heart. New ideas for scientific research. Conclusion: Our proposed RSU-Net network combines the advantages of residual connections and self-attention. This paper uses the residual links to facilitate the training of the network. In this paper, a self-attention mechanism is introduced, and a bottom self-attention block (BSA Block) is used to aggregate global information. Self-attention aggregates global information, and has achieved good segmentation results on the cardiac segmentation dataset. It facilitates the diagnosis of cardiovascular patients in the future.