Motion segment decomposition of RGB-D sequences for human behavior understanding. (January 2017)

• Record Type: Journal Article
• Authors: Devanne, Maxime; Berretti, Stefano; Pala, Pietro; Wannous, Hazem; Daoudi, Mohamed; Del Bimbo, Alberto
• Is Part Of: Pattern recognition. Volume 61(2017:Jan.)
• Page Start: 222
• Page End: 233
• Publication Date: 2017-01
• Subjects: 3D human behavior understanding -- Temporal modeling -- Shape space analysis -- Online activity detection; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2016.07.041
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: In this paper, we propose a framework for analyzing and understanding human behavior from depth videos. The proposed solution first employs shape analysis of the human pose across time to decompose the full motion into short temporal segments representing elementary motions. Then, each segment is characterized by human motion and depth appearance around hand joints to describe the change in pose of the body and the interaction with objects. Finally, the sequence of temporal segments is modeled through a Dynamic Naive Bayes classifier, which captures the dynamics of elementary motions characterizing human behavior. Experiments on four challenging datasets evaluate the potential of the proposed approach in different contexts, including gesture or activity recognition and online activity detection. Competitive results in comparison with state-of-the-art methods are reported. Abstract : Highlights: We propose to decompose a human behavior sequence into relevant motion segments. Each motion segment is described by both human motion and depth appearance around hands. We model the sequence dynamics using a Dynamic Naive Bayesian classifier. We evaluate the method for various types of behavior: gesture, action and activity. The challenge of online detection of successive behaviors is also investigated.