HASA: Hybrid architecture search with aggregation strategy for echinococcosis classification and ovary segmentation in ultrasound images. (15th September 2022)

• Record Type: Journal Article
• Authors: Qian, Jikuan; Li, Rui; Yang, Xin; Huang, Yuhao; Luo, Mingyuan; Lin, Zehui; Hong, Wenhui; Huang, Ruobing; Fan, Haining; Ni, Dong; Cheng, Jun
• Is Part Of: Expert systems with applications. Volume 202(2022)
• Publication Date: 2022-09-15
• Subjects: Deep learning -- Network architecture search -- Ultrasound image -- Classification -- Segmentation; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.117242
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: Different from handcrafted features, deep neural networks can automatically learn task-specific features from data. Due to this data-driven nature, they have achieved remarkable success in various areas. However, manual design and selection of suitable network architectures are time-consuming and require substantial effort of human experts. To address this problem, researchers have proposed neural architecture search (NAS) algorithms which can automatically generate network architectures but suffer from heavy computational cost and instability if searching from scratch. In this paper, we propose a hybrid NAS framework for ultrasound (US) image classification and segmentation. The hybrid framework consists of a pre-trained backbone and several searched cells (i.e., network building blocks), which takes advantage of the strengths of both NAS and the expert knowledge from existing convolutional neural networks. Specifically, two effective and lightweight operations, a mixed depth-wise convolution operator and a squeeze-and-excitation block, are introduced into the candidate operations to enhance the variety and capacity of the searched cells. These two operations not only decrease model parameters but also boost network performance. Moreover, we propose a re-aggregation strategy for the searched cells, aiming to further improve the performance for different vision tasks. We tested our method on two large US image datasets, including a 9-class echinococcosis dataset containing 9566 images for classification and an ovary dataset containing 3204 images for segmentation. Ablation experiments and comparison with other handcrafted or automatically searched architectures demonstrate that our method can generate more powerful and lightweight models for the above US image classification and segmentation tasks. Highlights: A hybrid NAS framework that also utilizes expert knowledge from existing CNNs. Progressive growing to stabilize the search process. Cell re-aggregation to adapt to different tasks. Extensive comparisons in two large US image datasets demonstrate the superiority.