A novel approach for gesture control video games based on perceptual features: modelling, tracking and recognition. (1st January 2012)

• Record Type: Journal Article
• Authors: Hu, Gang; Gao, Qigang
• Is Part Of: International journal of computational vision and robotics. Volume 3:Number 1/2(2012)
• Page Start: 75
• Page End: 95
• Publication Date: 2012-01-01
• Subjects: gesture control-based video game interface -- TOF 3D camera -- perceptual feature extraction -- tracking by grouping -- gesture representation -- modelling and recognition -- computational vision and robotics; Computer vision -- Periodicals; Robotics -- Periodicals; Artificial intelligence -- Periodicals; 006.3705
• Languages: English
• ISSNs: 1752-9131

Abstract

Gesture recognition has been an attractive research area for decades. Recently, the video game industry has become the major driving force for the development of advanced gesture control technologies. Conventional video games are controlled via physical devices. In contrast, the emerging trend is using camera-based human computer interface (HCI) to capture human gestures and control game playing directly. This paper presents a novel approach for facilitating the development of gesture control-based video games. A time-of-flight (TOF) camera is adopted to provide both depth and greyscale image sequences. 3D perceptual gesture features are extracted and grouped into a generic gesture representation for target gesture recognition. The game control parameters are derived from the recognised gestures on the fly. This framework includes five key modules: 1 perceptual feature extraction 2 object tracking by perceptual grouping 3 representation and modelling 4 gesture recognition 5 game control parameter generation. A proof-of-concept dart game is implemented for demonstration and evaluation.