TransMVU: Multi‐view 2D U‐Nets with transformer for brain tumour segmentation. Issue 6 (14th February 2023)

• Record Type: Journal Article
• Authors: Liu, Zengxin; Ma, Caiwen; She, Wenji; Wang, Xuan
• Is Part Of: IET image processing. Volume 17:Issue 6(2023)
• Page Start: 1874
• Page End: 1882
• Publication Date: 2023-02-14
• Subjects: image segmentation -- medical image processing -- tumours; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/ipr2.12762
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract: Medical image segmentation remains particularly challenging for complex and low‐contrast anatomical structures, especially in brain MRI glioma segmentation. Gliomas appear with extensive heterogeneity in appearance and location on brain MR images, making robust tumour segmentation extremely challenging and leads to highly variable even in manual segmentation. U‐Net has become the de facto standard in medical image segmentation tasks with great success. Previous researches have proposed various U‐Net‐based 2D Convolutional Neural Networks (2D‐CNN) and their 3D variants, called 3D‐CNN‐based architectures, for capturing contextual information. However, U‐Net often has limitations in explicitly modelling long‐term dependencies due to the inherent locality of convolution operations. Inspired by the recent success of natural language processing transformers in long‐range sequence learning, a multi‐view 2D U‐Nets with transformer (TransMVU) method is proposed, which combines the advantages of transformer and 2D U‐Net. On the one hand, the transformer encodes the tokenized image patches in the CNN feature map into an input sequence for extracting global context for global feature modelling. On the other hand, multi‐view 2D U‐Nets can provide accurate segmentation with fewer parameters than 3D networks. Experimental results on the BraTS20 dataset demonstrate that our model outperforms state‐of‐the‐art 2D models and classic 3D model. Abstract : Aiming at the problems of insufficient modelling long‐term dependencies and high computational cost of 3D methods in traditional brain MRI tumour segmentation algorithms, this paper proposes a multi‐view 2D U‐Nets with transformer (TransMVU) method. It combines the advantages of transformer and 2D U‐Net to achieve efficient and accurate segmentation. The model is trained and validated on the BraTS20 dataset, and the experimental results show that the proposed model outperforms state‐of‐the‐art 2D models and classic 3D models.