Automatic brain tumor segmentation from Multiparametric MRI based on cascaded 3D U-Net and 3D U-Net++. (September 2022)

• Record Type: Journal Article
• Authors: Li, Pengyu; Wu, Wenhao; Liu, Lanxiang; Michael Serry, Fardad; Wang, Jinjia; Han, Hui
• Is Part Of: Biomedical signal processing and control. Volume 78(2022)
• Publication Date: 2022-09
• Subjects: Brain tumor segmentation -- Grade glioma -- Multi-sequence MRI -- Cascaded network -- 3D U-Net++; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.103979
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: A segmentation network of 3D U-net and 3D U-net++ cascaded for segmentation of different brain tumor sub-regions. The enhanced tumor is smaller and more complex than other sub-regions which make us use U-Net++ that has deeper supervision and can integrate and utilize more network features to segment them. The input of the cascade sub-network is determined according to the imaging effects of different sequences on different brain tumor sub-regions. The strategy to fuse is to determine the region marked more than once in the prediction results of the three views as the final tumor region. The magnetic resonance imaging test datasets provided by the hospital are used for the test and the prediction results satisfactory to the physicians are obtained. Abstract: Purpose: Brain tumor is often a deadly disease and its diagnosis and treatment are challenging tasks for physicians for the heterogeneous nature of the tumor cells. Automatic, accurate segmentation of brain tumors can be a significant tool to assist physicians in the diagnosis of brain diseases. Existing methods can achieve general results, the segmentation accuracy not comparable to that of manual segmentation by experienced physicians, especially in enhanced tumor regions. Methods: We trained cascaded 3D U-Net and 3D U-Net++ networks to realize the automatic segmentation of brain tumors in Magnetic Resonance Imaging (MRI) images from the Brain Tumor Segmentation Challenge 2019 dataset (BRATS 2019). First, we decompose the segmentation of brain tumor into the segmentation of the whole tumor (WT), tumor core (TC) and enhanced tumor (ET). Second, we train the models in axial, coronal, and sagittal plane images. We then fuse the results from the three views to produce the final segmentation result. In particular, the U-Net++ is used to segment the enhanced tumor for the latter's more complex structure compared with other sub-regions. We also tested the performance of the methods on a clinical MRI image dataset with manual standard tumor contours. Results: The networks' performances were verified on BRATS 2019 images. On the clinical dataset, we got DSC metric values of 0.890, 0.842, and 0.835 for the complete, core, and enhanced regions respectively. Segmentation performance on the clinical dataset, especially the performance of 3D-UNet++, has been approved by physicians. Conclusion: The method's performance is clinically of significance.