Dual attention convolutional network for action recognition. Issue 6 (2nd April 2020)

• Record Type: Journal Article
• Authors: Li, Xiaoqiang; Xie, Miao; Zhang, Yin; Ding, Guangtai; Tong, Weiqin
• Is Part Of: IET image processing. Volume 14:Issue 6(2020)
• Page Start: 1059
• Page End: 1065
• Publication Date: 2020-04-02
• Subjects: image sequences -- video signal processing -- image motion analysis -- feature extraction -- image recognition -- convolutional neural nets -- image colour analysis; action recognition -- spatial features -- temporal features -- two‐stream ConvNets -- Dual Attention ConvNet -- dual attention mechanism -- spatial attention -- temporal attention -- 2D ConvNet -- two‐stream convolutional networks -- RGB frames -- multiple video frames -- UCF‐101 benchmark -- HMDB‐51 benchmark; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2019.0963
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : Action recognition has been an active research area for many years. Extracting discriminative spatial and temporal features of different actions plays a key role in accomplishing this task. Current popular methods of action recognition are mainly based on two‐stream Convolutional Networks (ConvNets) or 3D ConvNets. However, the computational cost of two‐stream ConvNets is high for the requirement of optical flow while 3D ConvNets takes too much memory because they have a large amount of parameters. To alleviate such problems, the authors propose a Dual Attention ConvNet (DANet) based on dual attention mechanism which consists of spatial attention and temporal attention. The former concentrates on main motion objects in a video frame by using ConvNet structure and the latter captures related information of multiple video frames by adopting self‐attention. Their network is entirely based on 2D ConvNet and takes in only RGB frames. Experimental results on UCF‐101 and HMDB‐51 benchmarks demonstrate that DANet gets comparable results among leading methods, which proves the effectiveness of the dual attention mechanism.