A role‐entity based human activity recognition using inter‐body features and temporal sequence memory. Issue 11 (17th March 2022)

• Record Type: Journal Article
• Authors: Shrivastava, Rahul; Tiwari, Vivek; Jain, Swati; Tiwari, Basant; Kushwaha, Alok Kumar Singh; Singh, Vibhav Prakash
• Is Part Of: IET image processing. Volume 16:Issue 11(2022)
• Page Start: 2911
• Page End: 2921
• Publication Date: 2022-03-17
• Subjects: Image processing -- Periodicals; 621.36705
• DOI: 10.1049/ipr2.12472
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract: Recognizing entities and their corresponding roles are important in human activity recognition. In light of recent advancements, the primary emphasis is recognizing the abstract activities involving person‐person interaction. The contribution of this work is proposing an architecture, which utilizes the knowledge of the human body parts coordinates in role detection of each individual. The network preprocesses the coordinates to build intra‐body and inter‐body features. The extracted features build the relationship between the interacting bodies and learn the temporal relation corresponding to each role using the human memory‐inspired hierarchical temporal memory. The model is tested on vague samples of mutual actions in the experimental work. The model is found robust in action and role recognition tasks and performed well per expectations.