Coupled convolution layer for convolutional neural network. (September 2018)

• Record Type: Journal Article
• Authors: Uchida, Kazutaka; Tanaka, Masayuki; Okutomi, Masatoshi
• Is Part Of: Neural networks. Volume 105(2018)
• Page Start: 197
• Page End: 205
• Publication Date: 2018-09
• Subjects: Neural network -- Learning and adaptive system -- Classification; Neural computers -- Periodicals; Neural networks (Computer science) -- Periodicals; Neural networks (Neurobiology) -- Periodicals; Nervous System -- Periodicals; Ordinateurs neuronaux -- Périodiques; Réseaux neuronaux (Informatique) -- Périodiques; Réseaux neuronaux (Neurobiologie) -- Périodiques; Neural computers; Neural networks (Computer science); Neural networks (Neurobiology); Periodicals; 006.32
• DOI: 10.1016/j.neunet.2018.05.002
• Languages: English
• ISSNs: 0893-6080

Abstract

Abstract: We propose a coupled convolution layer comprising multiple parallel convolutions with mutually constrained filters. Inspired by biological human vision mechanism, we constrain the convolution filters such that one set of filter weights should be geometrically rotated, mirrored, or be the negative of the other. Our analysis suggests that the coupled convolution layer is more effective for lower layer where feature maps preserve geometric properties. Experimental comparisons demonstrate that the proposed coupled convolution layer performs slightly better than the original layer while decreasing the number of parameters. We evaluate its effect compared to non-constrained convolution layer using the CIFAR-10, CIFAR-100, and PlanktonSet 1.0 datasets.