Automatic Schaeffer's gestures recognition system. Issue 5 (13th July 2016)

• Record Type: Journal Article
• Authors: Gomez‐Donoso, Francisco; Cazorla, Miguel; Garcia‐Garcia, Alberto; Garcia‐Rodriguez, Jose
• Is Part Of: Expert systems. Volume 33:Issue 5(2016)
• Page Start: 480
• Page End: 488
• Publication Date: 2016-07-13
• Subjects: Schaeffer's gestures -- 3D gesture recognition -- human–machine Interaction -- RGB‐D sensors; Expert systems (Computer science); 006.33
• DOI: 10.1111/exsy.12160
• Languages: English
• ISSNs: 0266-4720

Abstract

Abstract: Schaeffer's sign language consists of a reduced set of gestures designed to help children with autism or cognitive learning disabilities to develop adequate communication skills. Our automatic recognition system for Schaeffer's gesture language uses the information provided by an RGB‐D camera to capture body motion and recognize gestures using dynamic time warping combined with k‐nearest neighbors methods. The learning process is reinforced by the interaction with the proposed system that accelerates learning itself thus helping both children and educators. To demonstrate the validity of the system, a set of qualitative experiments with children were carried out. As a result, a system which is able to recognize a subset of 11 gestures of Schaeffer's sign language online was achieved.