Comparison of convolutional neural network training strategies for cone-beam CT image segmentation. (August 2021)

• Record Type: Journal Article
• Authors: Minnema, Jordi; Wolff, Jan; Koivisto, Juha; Lucka, Felix; Batenburg, Kees Joost; Forouzanfar, Tymour; van Eijnatten, Maureen
• Is Part Of: Computer methods and programs in biomedicine. Volume 207(2021)
• Publication Date: 2021-08
• Subjects: Medical image segmentation -- Deep learning -- Convolutional neural networks -- Training strategies -- Cone-beam computed tomography; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2021.106192
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: Comprehensive comparison between convolutional neural network training strategies. Acquisition of simulated and experimental cone-beam CT images with high-quality gold standard labels. Developed a novel orientation-based metric to quantify segmentation performance. Demonstrated that the orientation of anatomical structures affects segmentation performance. Abstract: Background and objective: Over the past decade, convolutional neural networks (CNNs) have revolutionized the field of medical image segmentation. Prompted by the developments in computational resources and the availability of large datasets, a wide variety of different two-dimensional (2D) and three-dimensional (3D) CNN training strategies have been proposed. However, a systematic comparison of the impact of these strategies on the image segmentation performance is still lacking. Therefore, this study aimed to compare eight different CNN training strategies, namely 2D (axial, sagittal and coronal slices), 2.5D (3 and 5 adjacent slices), majority voting, randomly oriented 2D cross-sections and 3D patches. Methods: These eight strategies were used to train a U-Net and an MS-D network for the segmentation of simulated cone-beam computed tomography (CBCT) images comprising randomly-placed non-overlapping cylinders and experimental CBCT images of anthropomorphic phantom heads. The resulting segmentation performances were quantitatively compared by calculating Dice similarity coefficients. In addition, all segmented and gold standard experimental CBCT images were converted into virtual 3D models and compared using orientation-based surface comparisons. Results: The CNN training strategy that generally resulted in the best performances on both simulated and experimental CBCT images was majority voting. When employing 2D training strategies, the segmentation performance can be optimized by training on image slices that are perpendicular to the predominant orientation of the anatomical structure of interest. Such spatial features should be taken into account when choosing or developing novel CNN training strategies for medical image segmentation. Conclusions: The results of this study will help clinicians and engineers to choose the most-suited CNN training strategy for CBCT image segmentation.