A novel effective and efficient capsule network via bottleneck residual block and automated gradual pruning. (December 2019)

• Record Type: Journal Article
• Authors: Zhang, Xiankun; Sun, Yue; Wang, Yuan; Li, Zixuan; Li, Na; Su, Jing
• Is Part Of: Computers & electrical engineering. Volume 80(2019)
• Publication Date: 2019-12
• Subjects: Capsule network -- Bottleneck residual block -- Automated gradual pruning -- Model compression; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2019.106481
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: Capsule Network (CapsNet) complements the invariance properties of the convolutional neural network with equivariance through pose estimation. While CapsNet achieves a very decent performance with a shallow architecture, it suffers from heavily parameters learning in the primary capsule layer, and has a poor performance on large or complex datasets. To tackle these problems, this paper benefits CapsNet from two techniques of model compression: bottleneck residual block and automated gradual pruning. Specifically, this paper designs an end-to-end framework, denoted as Deft Capsule (DCaps). In order to reduce the number of need-to-learn parameters, this paper applies the bottleneck residual blocks to the primary capsule layer. Furthermore, this paper obtains automated gradual pruning techniques in dynamic routing to improve the performance of DCaps. Experiment results on four classic datasets demonstrate that DCaps learns fast and significantly outperforms CapsNet in image classification tasks.