Structured dynamic time warping for continuous hand trajectory gesture recognition. (August 2018)

• Record Type: Journal Article
• Authors: Tang, Jingren; Cheng, Hong; Zhao, Yang; Guo, Hongliang
• Is Part Of: Pattern recognition. Volume 80(2018:Aug.)
• Page Start: 21
• Page End: 31
• Publication Date: 2018-08
• Subjects: Continuous hand gesture recognition -- Dynamic time warping -- Continuous trajectory segment -- Human computer interaction; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.02.011
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We use the positions of the corner points in arbitrary trajectories as a kind of structured information, and assign different weights to feature sequences based on the structure. We propose a natural continuous trajectory segmentation approach, which combines templates and velocity to detect the beginning and ending points in hand gesture trajectories. We combine position and orientation features with DTW to make trajectories more discriminative. Abstract: Continuous hand gesture recognition is an important area of HCI and challenged by various writing habits and unconstrained hand movement. In this paper, we propose a Structured Dynamic Time Warping (SDTW) approach for continuous hand trajectory recognition. We first propose an automatic continuous trajectory segmentation approach which combines templates and velocity information to spot the beginning and ending points in hand gesture trajectories. Then we assign different weights to feature sequences based on the structured information, from the positions of corner points in the arbitrary trajectories. Finally, we evaluate the SDTW on the Continuous Letter Trajectory (CLT) database. Experimental results show that the proposed approach is robust to the diversity of same handwritten letter, and significantly outperforms state-of-the-art approaches.