An online spatio-temporal tensor learning model for visual tracking and its applications to facial expression recognition. (30th December 2017)

• Record Type: Journal Article
• Authors: Khan, Sheheryar; Xu, Guoxia; Chan, Raymond; Yan, Hong
• Is Part Of: Expert systems with applications. Volume 90(2017)
• Page Start: 427
• Page End: 438
• Publication Date: 2017-12-30
• Subjects: Object tracking -- Appearance model -- Incremental N-mode SVD -- Facial expression recognition; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2017.08.039
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: Visual tracking in videos is an essential component in human computer interaction. An online tensor based learning strategy is proposed for visual tracking. The tracking method show superior tracking performance in challenging conditions. The proposed tracker delivers the scale and orientation information of the target. Real time facial expression recognition system is presented using proposed tracker. Abstract: Robust visual tracking remains a technical challenge in real-world applications, as an object may involve many appearance variations. In existing tracking frameworks, objects in an image are often represented as vector observations, which discounts the 2-D intrinsic structure of the image. By considering an image in its actual form as a matrix, we construct the 3rd order tensor based object representation to preserve the spatial correlation within the 2-D image and fully exploit the useful temporal information. We perform incremental update of the object template using the N-mode SVD to model the appearance variations, which reduces the influence of template drifting and object occlusions. The proposed scheme efficiently learns a low-dimensional tensor representation through adaptively updating the eigenbasis of the tensor. Tensor based Bayesian inference in the particle filter framework is then utilized to realize tracking. We present the validation of the proposed tracking system by conducting the real-time facial expression recognition with video data and a live camera. Experiment evaluation on challenging benchmark image sequences undergoing appearance variations demonstrates the significance and effectiveness of the proposed algorithm.