HybridCTrm: Bridging CNN and Transformer for Multimodal Brain Image Segmentation. (1st October 2021)

• Record Type: Journal Article
• Authors: Sun, Qixuan; Fang, Nianhua; Liu, Zhuo; Zhao, Liang; Wen, Youpeng; Lin, Hongxiang
• Other Names: Peng Jialin Academic Editor.
• Is Part Of: Journal of healthcare engineering. Volume 2021(2021)
• Publication Date: 2021-10-01
• Subjects: Hospital buildings -- Environmental engineering -- Periodicals; Medical technology -- Periodicals; Medical informatics -- Periodicals; 610.28
• DOI: 10.1155/2021/7467261
• Languages: English
• ISSNs: 2040-2295

Abstract

Abstract : Multimodal medical image segmentation is always a critical problem in medical image segmentation. Traditional deep learning methods utilize fully CNNs for encoding given images, thus leading to deficiency of long-range dependencies and bad generalization performance. Recently, a sequence of Transformer-based methodologies emerges in the field of image processing, which brings great generalization and performance in various tasks. On the other hand, traditional CNNs have their own advantages, such as rapid convergence and local representations. Therefore, we analyze a hybrid multimodal segmentation method based on Transformers and CNNs and propose a novel architecture, HybridCTrm network. We conduct experiments using HybridCTrm on two benchmark datasets and compare with HyperDenseNet, a network based on fully CNNs. Results show that our HybridCTrm outperforms HyperDenseNet on most of the evaluation metrics. Furthermore, we analyze the influence of the depth of Transformer on the performance. Besides, we visualize the results and carefully explore how our hybrid methods improve on segmentations.