A block-encoding method for evolving neural network architecture. (24th August 2021)

• Record Type: Journal Article
• Authors: Shi, Xiaohu; Guo, Hongyan; Wu, Chunguo; Liang, Yanchun; Chang, Zhiyong
• Is Part Of: International journal of bio-inspired computation. Volume 18:Number 1(2021)
• Page Start: 27
• Page End: 37
• Publication Date: 2021-08-24
• Subjects: evolving neural networks -- network architecture -- block-encoding -- search space -- all convolutional network; Biologically-inspired computing -- Periodicals; Computational biology -- Periodicals; 572.0285
• Languages: English
• ISSNs: 1758-0366

Abstract

The architecture and parameters of convolutional neural networks have an important impact on their performance. To overcome the difficulties of most existing neural architecture search (NAS) methods, including fixed network architecture and huge computing cost, this paper proposes a block-encoding based on neural architecture evolving method. A new block-encoding method is designed to divide the convolutional neural network architecture into blocks consisting of multiple functional layers. Efficient mutating operation is designed to speed up evolutionary search and expand the evolution space of network architecture. Finally, the optimal evolved network is converted into an all-convolutional neural network with fewer parameters and more concise architecture. The experiments on image datasets indicate that the proposed method can greatly reduce network parameters and searching time, achieve competitive classification accuracy and directly obtain the corresponding all-convolutional neural network architecture.