Skeleton‐Based Human Action Recognition via Screw Matrices. Issue 4 (1st July 2017)

• Record Type: Journal Article
• Authors: Ding, Wenwen; Liu, Kai; XU, Biao; Cheng, Fei
• Is Part Of: Chinese journal of electronics. Volume 26:Issue 4(2017)
• Page Start: 790
• Page End: 796
• Publication Date: 2017-07-01
• Subjects: Skeleton joints -- Human activity recognition -- Screw algebra -- Lie group -- Lie algebra; image motion analysis -- image recognition -- learning (artificial intelligence) -- Lie algebras -- Lie groups -- matrix algebra -- vectors; skeleton‐based human action recognition -- low‐cost acquisition depth cameras -- 3D body skeleton extraction -- 3D videos -- 2D videos -- skeletal motions -- 3D space -- multibody rigid motion -- single body rigid motion -- Euclidean group -- Lie group -- differentiable manifold -- Lie‐algebraic properties -- screw algebra -- machine learning -- vector space -- public 3D action datasets -- MSR Action3D dataset -- UCF Kinect dataset -- Florence3D‐Action Dataset; Electronics -- Periodicals; Electronics -- China -- Periodicals; Electronics; China; Periodicals; 621.38105
• DOI: 10.1049/cje.2017.06.012
• Languages: English
• ISSNs: 1022-4653

Abstract

Abstract : With the recent advent of low‐cost acquisition depth cameras, extracting 3D body skeleton has become relatively easier, which significantly lighten many difficulties in 2D videos including occlusions, shadows and background extraction, etc. Directly perceived features, for example points, lines and planes, can be easily extracted from 3D videos such that we can employ rigid motions to represent skeletal motions in a geometric way. We apply screw matrices, acquired by using rotations and translations in 3D space, to model single and multi‐body rigid motion. Since screw matrices are members of the special Euclidean group SE (3), an action can be represented as a point on a Lie group, which is a differentiable manifold. Using Lie‐algebraic properties of screw algebra, isomorphic to se (3), the classical algorithms of machine learning in vector space can be expanded to manifold space. We evaluate our approached on three public 3D action datasets: MSR Action3D dataset, UCF Kinect dataset and Florence3D‐Action Dataset. The experimental results show that our approaches either match or exceed state‐of‐the‐art skeleton‐based human action recognition approaches.