A sparse coded composite descriptor for human activity recognition. Issue 1 (9th September 2021)

• Record Type: Journal Article
• Authors: Singh, Kuldeep; Dhiman, Chhavi; Vishwakarma, Dinesh Kumar; Makhija, Himanshu; Walia, Gurjit S.
• Is Part Of: Expert systems. Volume 39:Issue 1(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-09-09
• Subjects: activity recognition -- dictionary learning -- differential motion -- sparse coded composite descriptors -- sparse representation -- support vector machine; Expert systems (Computer science); 006.33
• DOI: 10.1111/exsy.12805
• Languages: English
• ISSNs: 0266-4720

Abstract

Abstract: This paper proposes a novel algorithm for computing discriminative descriptors named as a sparse coded composite descriptor (SCCD) for robust human activity recognition. The proposed method blends the state‐of‐the‐art handcrafted features and the discriminative nature of the sparse representation of visual information. The human activity is firstly modelled using any handcrafted feature, and then the sparse codes computed on a discriminative sparse dictionary of these features are embedded to provide discrimination in the feature set. Finally, a support vector machine (SVM) is trained using the proposed SCCDs to perform classification of different human activities. A new feature named as differential motion descriptor (DMD) is also proposed to extract the motion as well as spatial information from an activity video. The simulation results reveal that in comparison with the handcrafted feature, the corresponding SCCD improves the recognition accuracy significantly. The proposed method is compared with state‐of‐the‐art methods on KTH, Ballet, UCF50, and HMDB51 datasets and the proposed methodology of composite features outperforms these methods in terms of recognition accuracy.