Meeting brain–computer interface user performance expectations using a deep neural network decoding framework. (November 2018)

• Record Type: Journal Article
• Authors: Schwemmer, Michael; Skomrock, Nicholas; Sederberg, Per; Ting, Jordyn; Sharma, Gaurav; Bockbrader, Marcia; Friedenberg, David
• Is Part Of: Nature medicine. Volume 24:Number 11(2018)
• Page Start: 1669
• Page End: 1676
• Publication Date: 2018-11
• Subjects: Pathology, Molecular -- Periodicals; Molecular biology -- Periodicals; 610.724
• DOI: 10.1038/s41591-018-0171-y
• Languages: English
• ISSNs: 1078-8956

Abstract

Abstract Brain–computer interface (BCI) neurotechnology has the potential to reduce disability associated with paralysis by translating neural activity into control of assistive devices1–9 . Surveys of potential end-users have identified key BCI system features10–14, including high accuracy, minimal daily setup, rapid response times, and multifunctionality. These performance characteristics are primarily influenced by the BCI's neural decoding algorithm1, 15, which is trained to associate neural activation patterns with intended user actions. Here, we introduce a new deep neural network16 decoding framework for BCI systems enabling discrete movements that addresses these four key performance characteristics. Using intracortical data from a participant with tetraplegia, we provide offline results demonstrating that our decoder is highly accurate, sustains this performance beyond a year without explicit daily retraining by combining it with an unsupervised updating procedure3, 17–20, responds faster than competing methods8, and can increase functionality with minimal retraining by using a technique known as transfer learning21 . We then show that our participant can use the decoder in real-time to reanimate his paralyzed forearm with functional electrical stimulation (FES), enabling accurate manipulation of three objects from the grasp and release test (GRT)22 . These results demonstrate that deep neural network decoders can advance the clinical translation of BCI technology. Intracortical activity data recorded over 2 years in a tetraplegic patient is used to develop an artificial intelligence algorithm that achieves fast, accurate, and stable movement decoding to reenable real-time control of the paralyzed forearm.