Hand gesture recognition based on attentive feature fusion. (30th June 2020)
- Record Type:
- Journal Article
- Title:
- Hand gesture recognition based on attentive feature fusion. (30th June 2020)
- Main Title:
- Hand gesture recognition based on attentive feature fusion
- Authors:
- Yu, Bin
Luo, Zhiming
Wu, Huangbin
Li, Shaozi - Abstract:
- Summary: Video‐based hand gesture recognition plays an important role in human‐computer interaction (HCI). Recent advanced methods usually add 3D convolutional neural networks to capture the information from both spatial and temporal dimensions. However, these methods suffer the issue of requiring large‐scale training data and high computational complexity. To address this issue, we proposed an attentive feature fusion framework for efficient hand‐gesture recognition. In our proposed model, we utilize a shallow two‐stream CNNs to capture the low‐level features from the original video frame and its corresponding optical flow. Following, we designed an attentive feature fusion module to selectively combine useful information from the previous two streams based on the attention mechanism. Finally, we obtain a compact embedding of a video by concatenating features from several short segments. To evaluate the effectiveness of our proposed framework, we train and test our method on a large‐scale video‐based hand gesture recognition dataset, Jester. Experimental results demonstrate that our approach obtains very competitive performance on the Jester dataset with a classification accuracy of 95.77%.
- Is Part Of:
- Concurrency and computation. Volume 32:Number 22(2020)
- Journal:
- Concurrency and computation
- Issue:
- Volume 32:Number 22(2020)
- Issue Display:
- Volume 32, Issue 22 (2020)
- Year:
- 2020
- Volume:
- 32
- Issue:
- 22
- Issue Sort Value:
- 2020-0032-0022-0000
- Page Start:
- n/a
- Page End:
- n/a
- Publication Date:
- 2020-06-30
- Subjects:
- convolution -- attention -- hand gesture -- optical flow
Parallel processing (Electronic computers) -- Periodicals
Parallel computers -- Periodicals
004.35 - Journal URLs:
- http://onlinelibrary.wiley.com/ ↗
- DOI:
- 10.1002/cpe.5910 ↗
- Languages:
- English
- ISSNs:
- 1532-0626
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 3405.622000
British Library DSC - BLDSS-3PM
British Library STI - ELD Digital store - Ingest File:
- 14766.xml