Efficient inception V2 based deep convolutional neural network for real‐time hand action recognition. Issue 4 (18th February 2020)

• Record Type: Journal Article
• Authors: Bose, S. Rubin; Kumar, V. Sathiesh
• Is Part Of: IET image processing. Volume 14:Issue 4(2020)
• Page Start: 688
• Page End: 696
• Publication Date: 2020-02-18
• Subjects: convolution -- neural nets -- gesture recognition -- image classification -- feature extraction -- learning (artificial intelligence); AP -- Faster R‐CNN Inception V2 model -- real‐time hand gesture recognition system -- Efficient inception V2 -- real‐time hand action recognition -- effective network -- accurate deep convolutional neural network -- faster region‐based convolutional neural network -- standard data sets -- NUS hand posture data set‐II -- IoU value -- higher precision -- SSD Inception V2 model -- MITI‐HD 160; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2019.0985
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : The most effective and accurate deep convolutional neural network (faster region‐based convolutional neural network (Faster R‐CNN) Inception V2 model, single shot detector (SSD) Inception V2 model) based architectures for real‐time hand gesture recognition is proposed. The proposed models are tested on standard data sets (NUS hand posture data set‐II, Senz‐3D) and custom‐developed (MITI hand data set (MITI‐HD)) data set. The performance metrics are analysed for intersection over union (IoU) ranges between 0.5 and 0.95. IoU value of 0.5 resulted in higher precision compared to other IoU values considered (0.5:0.95, 0.75). It is observed that the Faster R‐CNN Inception V2 model resulted in higher precision (0.990 for APall, IoU = 0.5) compared to SSD Inception V2 model (0.984 for all ) for MITI‐HD 160. The computation time of Faster R‐CNN Inception V2 is higher compared to SSD Inception V2 model and also resulted in less number of mispredictions. Increasing the size of samples (MITI‐HD 300) resulted in improvement of APall = 0.991. Improvement in large (APlarge) and medium (APmedium) size detections are not significant when compared to small (APsmall) detections. It is concluded that the Faster R‐CNN Inception V2 model is highly suitable for real‐time hand gesture recognition system under unconstrained environments.