A lightweight and accurate double-branch neural network for four-class motor imagery classification. (May 2022)

• Record Type: Journal Article
• Authors: Ma, Weifeng; Gong, Yifei; Xue, Haojie; Liu, Yang; Lin, Xuefen; Zhou, Gongxue; Li, Yaru
• Is Part Of: Biomedical signal processing and control. Volume 75(2022)
• Publication Date: 2022-05
• Subjects: Brain-computer interfaces (BCIs) -- Electroencephalography (EEG) -- Motor imagery (MI) -- Deep learning -- Feature fusion; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.103582
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: The proposed lightweight CNN based on parallel structure improves the MI EEG decoding performance of the existing shallow networks. The experimental results revealed that it has excellent decoding performance on benchmark dataset compared with mainstream wide or deep and hybrid networks. The proposed model maintains a good balance between performance and complexity, obtains a satisfactory decoding performance with a low resource cost. It is friendly for BCI hardware loaded with the algorithms because of low computer resource. Abstract: Deep learning is an important pathway for investigation of motor imagery signal classification. Nevertheless, maintaining a good compromise between performance and computational cost has been a major challenge in developing deep models for decoding motor imagery EEG. In this paper, a novel shallow double-branch convolutional neural network (DSCNN) is proposed for four-class motor imagery classification. The proposed CNN adopts parallel extraction of two branches to improve classification accuracy. Meanwhile, in order to constrain the depth of the whole network, the left branch only contained two single temporal and spatial convolutional layers to extract common EEG features. Similarly, the right branch first introduced 1D convolution to exploit the channel dependency and temporal features across multiple time-scales, secondly a depth-wise separable convolutional layer was applied for optimizing EEG signal series. Then the feature representation for final classification was obtained by merging intermediate features extracted from the two branches. Also, the DSCNN is an end-to-end decoder, as it employs the raw EEG data as inputs and does not require additional complex preprocessing. The proposed model was evaluated on public benchmark BCI competition IV dataset 2a and achieved in terms of accuracy is 85% and kappa value is 0.79. Compared with other state-of-the-art algorithms, the experiment results reveal that the DSCNN has higher decoding accuracy and robustness, as well as a 10% improvement in accuracy than the single general shallow model. Furthermore, as a lightweight architecture, the DSCNN relies on a lower computational power than similar mainstream models, which is more in line with the requirements of low delay and real-time performance in practical BCI applications.