Brain segmentation based on multi-atlas and diffeomorphism guided 3D fully convolutional network ensembles. (July 2021)

• Record Type: Journal Article
• Authors: Wu, Jiong; Tang, Xiaoying
• Is Part Of: Pattern recognition. Volume 115(2021)
• Publication Date: 2021-07
• Subjects: Brain segmentation -- Fully convolutional network -- Multi-atlas -- Diffeomorphism -- Adaptive-size patches -- Ensemble model; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2021.107904
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We proposed a 3D CNN approach for brain structures segmentation that combines convolutional and multi-atlas features. An adaptive size of 3D ROI patches sampling technique to force the CNN to sufficiently learn the specific ROIs is presented. Abstract: In this study, we proposed and validated a multi-atlas and diffeomorphism guided 3D fully convolutional network (FCN) ensemble model (M-FCN) for segmenting brain anatomical regions of interest (ROIs) from structural magnetic resonance images (MRIs). A novel multi-atlas and diffeomorphism based encoding block and ROI patches with adaptive sizes were used. In the multi-atlas and diffeomorphism based encoding block, both MRI intensity profiles and expert priors from deformed atlases were encoded and fed to the proposed FCN. Utilizing patches with adaptive sizes enabled more efficient network training and testing. To incorporate both local and global contextual information of a specific ROI, we employed a long skip connection between the layer of the encoding block and the layer of the encoding-decoding block. To relieve over-fitting of the proposed FCN model on the training data, we adopted an ensemble strategy in the learning procedure. Systematic evaluations were performed on two brain MRI datasets, aiming respectively at segmenting 14 subcortical and ventricular structures and 54 whole-brain ROIs. Compared with two state-of-the-art segmentation methods including a multi-atlas based segmentation method and an existing 3D FCN segmentation model, the proposed method exhibited superior segmentation performance.