Comparing 3D trajectories for simple mid-air gesture recognition. (June 2018)

• Record Type: Journal Article
• Authors: Caputo, Fabio M.; Prebianca, Pietro; Carcangiu, Alessandro; Spano, Lucio D.; Giachetti, Andrea
• Is Part Of: Computers & graphics. Volume 73(2018)
• Page Start: 17
• Page End: 25
• Publication Date: 2018-06
• Subjects: Gestures recognition -- Trajectory matching -- Classification -- Mid-air gestures -- Gestures dataset; Computer graphics -- Periodicals; 006.6
• DOI: 10.1016/j.cag.2018.02.009
• Languages: English
• ISSNs: 0097-8493

Abstract

Highlights: Accurate recognition of command gestures characterized by both hand and finger motion. Mid air gesture recognition based on simple trajectory comparison. Comparison of different resampling and path processing methods. Graphical abstract: Abstract: User interfaces based on mid-air gesture recognition are expected to become popular in the near future due to the increasing diffusion of virtual, mixed reality applications and smart devices. The design of this kind of interfaces would be clearly helped by the availability of simple and effective methods to compare short 3D trajectories, allowing fast and accurate recognition of command gestures given a few examples. This approach, quite popular in 2D touch-based interfaces with the so-called "dollar" algorithm family, has not been deeply investigated for 3D mid-air gestures. In this paper, we explore several metrics that can be used for mid-air gesture comparison and present experimental tests performed to analyze their effectiveness on practical tasks. By adopting smart choices in gesture traces processing and comparing, it was possible to obtain very good results in the retrieval and recognition of simple command gestures, from complete or even partial hand trajectories. The approach was also extended in order to recognize gestures characterized by both hand and finger motions and tested on a recent benchmark, reaching state of the art performances.