From Kinect skeleton data to hand gesture recognition with radar. Issue 20 (24th September 2019)

• Record Type: Journal Article
• Authors: Li, Jiayi; Shrestha, Aman; Le Kernec, Julien; Fioranelli, Francesco
• Is Part Of: Journal of engineering. Volume 2019:Issue 20(2019)
• Page Start: 6914
• Page End: 6919
• Publication Date: 2019-09-24
• Subjects: support vector machines -- image classification -- gesture recognition -- image sensors -- feature extraction -- image sampling -- radar imaging -- Doppler radar; aperiodic human movements -- hand gestures -- handcrafted features -- simulated mD signatures -- Kinect skeleton data -- data augmentation -- synthetic minority oversampling technique -- synthetic samples -- support vector machine -- neighbour classifier -- gesture recognition -- man‐machine interaction -- remote sensing -- microDoppler effect; Engineering -- Periodicals; Engineering; Electronic journals; Periodicals; 620.005
• DOI: 10.1049/joe.2019.0557
• Languages: English
• ISSNs: 2051-3305

Abstract

Abstract : In an era where man‐machine interaction increasingly uses remote sensing, gesture recognition through use of the micro‐Doppler (mD) effect is an emerging application which has attracted great interest. It is a sensible solution and here the authors show its potential for detecting aperiodic human movements. In this study, the authors classify ten hand gestures with a set of handcrafted features using simulated mD signatures generated from Kinect skeleton data. Data augmentation in the form of synthetic minority oversampling technique has been applied to create synthetic samples and classified with the support vector machine and K‐nearest neighbour classifier with classification rate of 71.1 and 51% achieved. Finally, using weights generated by an action pair based one vs. one classification layer improves classification accuracy by 24.7 and 28.4%.