ATTransUNet: An enhanced hybrid transformer architecture for ultrasound and histopathology image segmentation. (January 2023)

• Record Type: Journal Article
• Authors: Li, Xuewei; Pang, Shuo; Zhang, Ruixuan; Zhu, Jialin; Fu, Xuzhou; Tian, Yuan; Gao, Jie
• Is Part Of: Computers in biology and medicine. Volume 152(2023)
• Publication Date: 2023-01
• Subjects: Ultrasound image segmentation -- Histopathology image segmentation -- Transformer -- U-Net -- Learnable tokens -- Feature selection; Medicine -- Data processing -- Periodicals; Biology -- Data processing -- Periodicals; 610.285
• DOI: 10.1016/j.compbiomed.2022.106365
• Languages: English
• ISSNs: 0010-4825

Abstract

Abstract: Recently, researchers have introduced Transformer into medical image segmentation networks to encode long-range dependency, which makes up for the deficiencies of convolutional neural networks (CNNs) in global context modeling, and thus improves segmentation performance. However, in Transformer, due to the heavy computational burden of paired attention modeling between redundant visual tokens, the efficiency of Transformer needs to be further improved. Therefore, in this paper, we propose ATTransUNet, a Transformer enhanced hybrid architecture based on the adaptive token for ultrasound and histopathology image segmentation. In the encoding stage of the ATTransUNet, we introduced an Adaptive Token Extraction Module (ATEM), which can mine a few important visual tokens in the image for self-attention modeling, thus reducing the complexity of the model and improving the segmentation accuracy. In addition, in the decoding stage, we introduce a Selective Feature Reinforcement Module (SFRM) to reinforce the representation of and attention to key tissues or pathological features. The proposed ATTransUNet is evaluated on the basis of three medical image segmentation datasets. The results show that ATTransUNet achieves the best segmentation performance compared with the previous state-of-the-art models, and the proposed method is also competitive in terms of the network parameters and computation. Highlights: A CNN/Transformer hybrid framework for medical image segmentation is proposed. Self-attention modeling of deep aggregated features can reduce redundant computation. Adaptive selection and reinforcement are used for pathological features. The experiments show excellent performance on three medical image datasets.