Automatic stimuli classification from ERP data for augmented communication via Brain–Computer Interfaces. (1st December 2021)

• Record Type: Journal Article
• Authors: Leoni, Jessica; Strada, Silvia Carla; Tanelli, Mara; Jiang, Kaijun; Brusa, Alessandra; Proverbio, Alice Mado
• Is Part Of: Expert systems with applications. Volume 184(2021)
• Publication Date: 2021-12-01
• Subjects: Event-related potentials -- Brain–computer interface -- Time-series classification -- Machine-learning -- Features importance; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2021.115572
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: This work presents a supervised machine-learning approach to build an expert system that provides support to the neuroscientist in automatically classifying ERP data and matching them with a multisensorial alphabet of stimuli. To do this, two different approaches are considered: a hierarchical tree-based algorithm, XGBoost, and feedfoward neural networks, highlighting the pros and cons of both approaches in the different steps of the classification task. Moreover, the sensitivity of the classification capabilities of the tool as a function of the number of available electrodes is also studied, highlighting what can be achieved by applying the method using commercial, wearable EEG systems. The main novelty of this work consists in significantly enlarging the pool of stimuli that the expert system can recognize and comprising different, possibly mixed, sensorial domains. The obtained results open the way to the design of portable devices for augmented communication systems, which can be of particular interest for the development of advanced Brain–Computer Interfaces (BCI) for communication with different types of neurologically impaired patients. Highlights: Automating the Event Related Potential classification ease the neuroscientist task. Data-driven analysis optimizes classifier's accuracy. A tree structure of binary splits leads to transparent prediction models. 14 Event Related Potential elicited by stimuli of different nature are discerned.