A novel restricted Boltzmann machine-based temporal-spatial correlation method for student behaviour recognition in depth video. (8th July 2022)

• Record Type: Journal Article
• Authors: Zhang, Fan
• Is Part Of: International journal of computational vision and robotics. Volume 12:Number 5(2022)
• Page Start: 487
• Page End: 505
• Publication Date: 2022-07-08
• Subjects: restricted Boltzmann machine -- RBM -- student behaviour recognition -- temporal-spatial correlation -- Fourier time pyramid algorithm; Computer vision -- Periodicals; Robotics -- Periodicals; Artificial intelligence -- Periodicals; 006.3705
• Languages: English
• ISSNs: 1752-9131

Abstract

Human behaviour recognition is an important research hotspot in the field of artificial intelligence. Current behaviour recognition methods have low recognition accuracy under different viewing angles, therefore, this paper proposes a novel restricted Boltzmann machine (RBM)-based temporal-spatial correlation method for student behaviour recognition in depth video. The RBM is used to map the human behaviour from different viewing angles to the high-dimensional space. The time level pooling function is applied in the time series activated by each neuron to realise the encoding of the video time sub-series. Finally, behaviour recognition and classification experiments are conducted on different public datasets and real classroom student behaviour datasets with other methods. The results show that the proposed method improves the accuracy of depth video recognition under different viewing angles and has good generalisation performance. The data analysis of abnormal behaviour in class can play an auxiliary role in dynamic classroom management.