A facial feature tracker for human-computer interaction based on 3D Time-Of-Flight cameras. (20th November 2008)

• Record Type: Journal Article
• Authors: Bohme, Martin; Haker, Martin; Martinetz, Thomas; Barth, Erhardt
• Is Part Of: International journal of intelligent systems technologies and applications. Volume 5:Number 3/4(2008)
• Page Start: 264
• Page End: 273
• Publication Date: 2008-11-20
• Subjects: AAC -- alternative and augmentative communication -- facial feature tracking -- geometric features -- head tracking -- head mouse -- 3D time-of-flight camera -- 3D TOF -- human-computer interaction -- HCI; Artificial intelligence -- Periodicals; Intelligent control systems -- Periodicals; 006.3
• Languages: English
• ISSNs: 1740-8865

Abstract

We describe a facial feature tracker based on the combined range and amplitude data provided by a 3D Time-Of-Flight camera. We use this tracker to implement a head mouse, an alternative input device for people who have limited use of their hands. The facial feature tracker is based on geometric features that are related to the intrinsic dimensionality of multidimensional signals. We show how the position of the nose in the image can be determined robustly using a very simple bounding-box classifier, trained on a set of labelled sample images. Despite its simplicity, the classifier generalises well to subjects that it was not trained on. An important result is that the combination of range and amplitude data dramatically improves robustness compared to a single type of data. The tracker runs in real time at around 30 frames per second. We demonstrate its potential as an input device by using it to control Dasher, an alternative text input tool.