A new approach for physical human activity recognition from sensor signals based on motif patterns and long-short term memory. (September 2022)

• Record Type: Journal Article
• Authors: Kuncan, Fatma; Kaya, Yılmaz; Yiner, Züleyha; Kaya, Mahmut
• Is Part Of: Biomedical signal processing and control. Volume 78(2022)
• Publication Date: 2022-09
• Subjects: Sensor signals -- HAR -- LSTM -- Motif patterns -- Feature extraction; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.103963
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: The Motif Patterns (MP) approach, which extracts features from sensor signals, is proposed for HAR. The classification was carried out with LSTM using MP features extracted from accelerometer and magnetometer signals. A dataset of 9120 signals was used to test the approach. A success rate of 98.42 % was achieved with the proposed method. According to the literature comparisons, successful results were observed with the MP + LSTM model proposed in this study. As a result, it is seen that the proposed feature extraction approach provides more effective features for HAR. Abstract: Numerous studies have been carried out in recent years on the recognition, tracking, and discrimination of human activities. Automatic recognition of physical activities is often referred to as human activity recognition (HAR). There are generally vision-based and sensor-based approaches for activity recognition. The computer vision-based approach generally works well in laboratory conditions, but it can fail in real-world problems due to clutter, variable light intensity, and contrast. Sensor-based HAR systems are realized by continuously monitoring and analyzing physiological signals measured from heterogeneous sensors connected to the person's body. In this study, the Motif Patterns (MP) approach, which extracts features from sensor signals, is proposed for HAR. The success of the HAR systems depends on the effectiveness of the features extracted from the signals. The LSTM network is a special kind of recurrent neural network that has been used to make very successful predictions on time series data where long-term dependencies are. The LSTM network type offers a successful solution approach to solving long-term dependencies problems such as human activity recognition. The classification process was carried out with Long-Short Term Memory (LSTM) using MP features extracted from accelerometer, gyroscope, and magnetometer sensor signals. A large dataset of 9120 signals was used to test the proposed approach. A high success rate of 98.42 % was achieved with the proposed MP + LSTM method. As a result, it has been seen that the proposed approach has been obtained with a high success rate for HAR using sensor signals.