Tensor-based linear dynamical systems for action recognition from 3D skeletons. (May 2018)

• Record Type: Journal Article
• Authors: Ding, Wenwen; Liu, Kai; Belyaev, Evgeny; Cheng, Fei
• Is Part Of: Pattern recognition. Volume 77(2018:May)
• Page Start: 75
• Page End: 86
• Publication Date: 2018-05
• Subjects: Skeleton joints -- Action recognition -- Subspace learning -- Tensor learning -- Grassmann manifold; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2017.12.004
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Some novel tensor representation for 3D skeleton are proposed. Tensor-based linear dynamical system is proposed. Higher recognition accuracy for different datasets are achieved. Abstract: Recent years have seen a growth in interest in skeleton-based human behavior recognition. Skeleton sequences can be expressed naturally as high-order tensor time series, and in this paper we report on the modeling and analysis of such time series using a linear dynamical system (LDS). Owing to their relative simplicity and efficiency, LDSs are the most common tool used in various disciplines for encoding spatiotemporal time series data. However, conventional LDSs process the latent and observed states at each frame of a video as a column vector, a representation that fails to take into account valuable structural information associated with human action. To correct this, we propose a tensor-based linear dynamical system (tLDS) for modeling tensor observations in time series and employ Tucker decomposition to estimate the parameters of the LDS model as action descriptors. In this manner, an action can be expressed as a subspace corresponding to a point on a Grassmann manifold on which classification can be performed using dictionary learning and sparse coding. Experiments using the MSR Action3D, UCF Kinect, and Northwestern-UCLA Multiview Action3D datasets demonstrate the excellent performance of our proposed method.