Probability‐based method for boosting human action recognition using scene context. Issue 6 (14th March 2016)

• Record Type: Journal Article
• Authors: Zhang, Hong‐Bo; Lei, Qing; Chen, Duan‐Sheng; Zhong, Bi‐Neng; Peng, Jialin; Du, Ji‐Xiang; Su, Song‐Zhi
• Is Part Of: IET computer vision. Volume 10:Issue 6(2016)
• Page Start: 528
• Page End: 536
• Publication Date: 2016-03-14
• Subjects: image motion analysis -- image sequences -- feature extraction -- Bayes methods -- video signal processing; probability based method -- boosting human action recognition -- associated scene context -- bridge action descriptors -- action categories -- hybrid visual descriptors -- spatial temporal action features -- video sequence -- joint probability distribution -- naive Bayes nearest neighbour algorithm; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/iet-cvi.2015.0420
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract : In this study, the authors investigate the possibility of boosting action recognition performance by exploiting the associated scene context. Towards this end, the authors model a scene as a mid‐level 'middle layer' in order to bridge action descriptors and action categories. This is achieved via a scene topic model, in which hybrid visual descriptors, including spatial–temporal action features and scene descriptors, are first extracted from a video sequence. Then, the authors learn a joint probability distribution between scene and action using a naive Bayes nearest neighbour algorithm, which is adopted to jointly infer the action categories online by combining off‐the‐shelf action recognition algorithms. The authors demonstrate the advantages of their approach by comparing it with state‐of‐the‐art approaches using several action recognition benchmarks.