Alpha‐numeric hand gesture recognition based on fusion of spatial feature modelling and temporal feature modelling. Issue 20 (9th September 2016)

• Record Type: Journal Article
• Authors: Yang, C.; Ku, B.; Han, D.K.; Ko, H.
• Is Part Of: Electronics letters. Volume 52:Issue 20(2016)
• Page Start: 1679
• Page End: 1681
• Publication Date: 2016-09-09
• Subjects: gesture recognition -- feature extraction -- handwritten character recognition -- computer vision -- neural nets -- performance evaluation; alpha‐numeric hand gesture recognition -- spatial feature modelling -- alphabet -- numeric characters -- vision enabled smart devices -- user interface -- handwriting style -- individualistic styles -- vision based gesture recognition -- temporal‐feature‐state modelling -- total‐trajectory‐shape modelling -- convolution neural network -- conditional random fields -- public database -- performance improvement; Electronics -- Periodicals; 621.381
• DOI: 10.1049/el.2016.0841
• Languages: English
• ISSNs: 0013-5194

Abstract

Abstract : Alpha‐numeric gesture refers to writing in air of alphabet and numeric characters. With prevalent usage of vision enabled smart devices, these gestures are considered as an alternative user interface. As each individual has a unique handwriting style, it has been observed that alpha‐numeric gesturing also exhibits different individualistic styles, posing a challenge to the vision based gesture recognition. In this Letter, a simple but effective method of modelling alpha‐numeric hand gestures by fusing temporal‐feature‐state modelling and total‐trajectory‐shape modelling is proposed. The proposed method employs a convolution neural network that represents total‐trajectory‐shapes, and combines it with conventional conditional random fields based temporal‐feature‐state modelling. The proposed algorithm is evaluated in public database of both alphabet and numeric hand gestures. Experimental results show a performance improvement of the proposed algorithm compared with the state‐of‐the art methods.