Stochastic weight averaging enhanced temporal convolution network for EEG-based emotion recognition. (May 2023)

• Record Type: Journal Article
• Authors: Yang, Lijun; Wang, Yixin; Yang, Xiaohui; Zheng, Chen
• Is Part Of: Biomedical signal processing and control. Volume 83(2023)
• Publication Date: 2023-05
• Subjects: Emotion recognition -- Electroencephalogram (EEG) -- Temporal convolutional network -- Stochastic weight averaging -- Electrode reduction; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2023.104661
• Languages: English
• ISSNs: 1746-8094

Abstract

Abstract: Emotion plays an important role in human–computer interactions, in which emotion recognition is the key problem. Electroencephalogram (EEG) has been widely used in emotion recognition due to its high temporal resolution and reliability. In this study, we propose a strategy in which stochastic weight averaging is introduced into an improved temporal convolutional network for emotion recognition. The temporal convolution network not only is suitable for sequence models such as the recurrent neural networks, but also retains the characteristics of parallel computing similar to convolutional neural networks. Considering that the traditional softmax loss does not explicitly encourage discriminative learning of features, we further introduce an improved version of the loss function that explicitly encourages intraclass compactness and interclass separability between learned features. Moreover, the method of stochastic weight averaging is introduced into the network framework to make the network find the point closest to the global optimum by adjusting the learning rate and updating the weight, which can effectively alleviate the local optimum problem. We test the performance of the proposed strategy on two open emotion EEG datasets: DEAP and SEED. The experimental results show that the new strategy has higher recognition accuracy than the state-of-the-art approaches. Moreover, to investigate the general pattern of brain functional connectivity in different individuals, we select the key electrodes and analyze the roles of various brain regions in processing different emotions. Highlights: An alternative strategy, called SITCN, is proposed for emotion recognition. SITCN improves the TCN by introducing SWA and an improved softmax. The relationship between five rhythms and different emotional modes is analyzed. Key electrodes are selected which provide a new idea for portable EEG equipment.