Ambient intelligence-based multimodal human action recognition for autonomous systems. (January 2023)

• Record Type: Journal Article
• Authors: Jain, Vidhi; Gupta, Gaurang; Gupta, Megha; Sharma, Deepak Kumar; Ghosh, Uttam
• Is Part Of: ISA transactions. Volume 132(2023)
• Page Start: 94
• Page End: 108
• Publication Date: 2023-01
• Subjects: Ambient assisted living, Auto fusion, Autonomous techniques, Convolution-recurrent neural network, Human activity detection, Hybrid deep learning; Engineering instruments -- Periodicals; Engineering instruments; Periodicals; Electronic journals; 629.805
• DOI: 10.1016/j.isatra.2022.10.034
• Languages: English
• ISSNs: 0019-0578

Abstract

Abstract: Human activity recognition can deduce the behaviour of one or more people from a set of sensor measurements. Despite its widespread applications in monitoring activities, robotics, and visual surveillance, accurate, meticulous, precise and efficient human action recognition remains a challenging research area. As human beings are moving towards the establishment of a smarter planet, human action recognition using ambient intelligence has become an area of huge potential. This work presents a method based on Bi-Convolutional Recurrent Neural Network (Bi-CRNN) -based Feature Extraction and then Random Forest classification for achieving outcomes utilizing Ambient Intelligence that are at the cutting edge of human action recognition for Autonomous Robots. The auto fusion technique used has improved fusion for utilizing and processing data from various sensors. This paper has drawn comparisons with already existing algorithms for Human Action Recognition (HAR) and tried to propose a heuristic and constructive hybrid deep learning-based algorithm with an accuracy of 94.7%.