A deep convolutional neural network module that promotes competition of multiple-size filters. (November 2017)

• Record Type: Journal Article
• Authors: Liao, Zhibin; Carneiro, Gustavo
• Is Part Of: Pattern recognition. Volume 71(2017:Nov.)
• Page Start: 94
• Page End: 105
• Publication Date: 2017-11
• Subjects: Deep learning -- Multi-size filter -- Filter co-adaptation -- Classification; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2017.05.024
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A new deep ConvNet module that promotes competition amongst a set of multiple size filters. The competition is promoted by pooling the filter responses with max-pooling operation. This module can prevent filter co-adaptation. The results are competitive with the state-of-the-art results on MNIST, CIFAR-10, CIFAR-100, SVHN and ImageNet. Abstract: We introduce a new deep convolutional neural network (ConvNet) module that promotes competition amongst a set of convolutional filters of multiple sizes. This new module is inspired by the inception module, where we replace the original collaborative pooling stage (consisting of a concatenation of the multiple size filter outputs) by a competitive pooling represented by a maxout activation unit. This extension has the following two objectives: 1) the selection of the maximum response amongst the multiple size filters prevents filter co-adaptation and allows the formation of multiple sub-networks within the same model, which has been shown to facilitate the training of complex learning problems; and 2) the maxout unit reduces the dimensionality of the outputs from the multiple size filters. We show that the use of our proposed module in typical deep ConvNets produces classification results that are competitive with the state-of-the-art results on the following benchmark datasets: MNIST, CIFAR-10, CIFAR-100, SVHN, and ImageNet ILSVRC 2012.