Transformation classification of human squat/sit-to-stand based on multichannel information fusion. (8th July 2022)

• Record Type: Journal Article
• Authors: Wang, Yu; Song, Quanjun; Ma, Tingting; Chen, Yong; Li, Hao; Liu, Rongkai
• Is Part Of: International journal of advanced robotic systems. Volume 19:Number 4(2022)
• Publication Date: 2022-07-08
• Subjects: Human action recognition -- feature-level fusion -- decision-level fusion -- inertial sensor -- pressure sensor -- RGB camera; Robotics -- Periodicals; Robotics; Periodicals; 629.892
• DOI: 10.1177/17298806221103708
• Languages: English
• ISSNs: 1729-8806

Abstract

In existing rehabilitation training, research on the accuracy of recognizing completed actions has achieved good results; however, the reduction in the misjudgment rate in the action conversion process needs further research. This article proposes a multichannel information fusion method for the movement conversion process of squat/sit-to-stand, which can help online movement conversion classification during rehabilitation training. We collected a training dataset from a total of eight subjects performing three different motions, including half squat, full squat, and sitting, equipped with plantar pressure sensors, RGB cameras, and five inertial measurement units. Our evaluation includes the misjudgment rate for each action and the time needed for classification. The experimental results show that, compared with the recognition of a single sensor, the accuracy after fusion can reach 96.6% in the case of no occlusion and 86.7% in the case of occlusion. Compared with the complete time window, the classification time window is shortened by approximately 25%.