A novel visual classification framework on panoramic attention mechanism network. Issue 6 (15th April 2022)

• Record Type: Journal Article
• Authors: Li, Wenshu; Li, Shenhao; Yin, Lingzhi; Guo, Xiaoying; Yang, Xu
• Is Part Of: IET computer vision. Volume 16:Issue 6(2022)
• Page Start: 479
• Page End: 488
• Publication Date: 2022-04-15
• Subjects: fine‐grained image classification model -- multi‐branch network for cooperative training -- panoramic attention mechanism -- significant feature extraction; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/cvi2.12105
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract: Fine‐grained classification is a challenging task due to the difficulty of finding discriminative features and the localization of feature regions. To handle these challenges, a novel visual classification framework on panoramic attention mechanism that combines multiple attention networks to locate and identify features with more semantic interest is proposed. Firstly, based on the classical convolutional neural network, the global information of the image feature is expressed by linear fusion. Secondly, the foreground attention branch is used to further extract the distinguishing details of the salient features. Then, more features are mined from the complementary object area through the background attention branch to learn more perfect fine‐grained feature expression. Finally, three network branches are trained together to enhance the network's ability to express representative features of fine‐grained images. Our model can be viewed as a multi‐branch network, which benefits each other and optimizes the network together. Experiments were conducted on CUB‐200‐2011, Stanford Dogs and FGVC‐Aircraft datasets, and the accuracy was used as the quantitative measurement. Experimental results show that the proposed method has the highest accuracy; the average accuracy is 89.8%. It is effective and superior to the current advanced methods.