Interpretable functional specialization emerges in deep convolutional networks trained on brain signals. (1st June 2022)

• Record Type: Journal Article
• Authors: Hammer, J; Schirrmeister, R T; Hartmann, K; Marusic, P; Schulze-Bonhage, A; Ball, T
• Is Part Of: Journal of neural engineering. Volume 19:Number 3(2022)
• Publication Date: 2022-06-01
• Subjects: motor decoding -- intracranial EEG (iEEG) -- deep learning -- brain–computer interface (BCI) -- neural network visualization -- internal representation -- explainable AI (XAI); Neurosciences -- Periodicals; Biomedical engineering -- Periodicals; 612.8
• DOI: 10.1088/1741-2552/ac6770
• Languages: English
• ISSNs: 1741-2560

Abstract

Abstract: Objective. Functional specialization is fundamental to neural information processing. Here, we study whether and how functional specialization emerges in artificial deep convolutional neural networks (CNNs) during a brain–computer interfacing (BCI) task. Approach. We trained CNNs to predict hand movement speed from intracranial electroencephalography (iEEG) and delineated how units across the different CNN hidden layers learned to represent the iEEG signal. Main results. We show that distinct, functionally interpretable neural populations emerged as a result of the training process. While some units became sensitive to either iEEG amplitude or phase, others showed bimodal behavior with significant sensitivity to both features. Pruning of highly sensitive units resulted in a steep drop of decoding accuracy not observed for pruning of less sensitive units, highlighting the functional relevance of the amplitude- and phase-specialized populations. Significance. We anticipate that emergent functional specialization as uncovered here will become a key concept in research towards interpretable deep learning for neuroscience and BCI applications.