Utilising reinforcement learning to develop strategies for driving auditory neural implants. (19th July 2016)

• Record Type: Journal Article
• Authors: Lee, Geoffrey W; Zambetta, Fabio; Li, Xiaodong; Paolini, Antonio G
• Is Part Of: Journal of neural engineering. Volume 13:Number 4(2016:Aug.)
• Publication Date: 2016-07-19
• Subjects: reinforcement learning -- neural implant -- auditory prosthetic -- closed loop -- brain machine interface -- penetrating neural electrode array -- auditory neural stimulation; Neurosciences -- Periodicals; Biomedical engineering -- Periodicals; 612.8
• DOI: 10.1088/1741-2560/13/4/046027
• Languages: English
• ISSNs: 1741-2560

Abstract

Abstract: Objective. In this paper we propose a novel application of reinforcement learning to the area of auditory neural stimulation. We aim to develop a simulation environment which is based off real neurological responses to auditory and electrical stimulation in the cochlear nucleus (CN) and inferior colliculus (IC) of an animal model. Using this simulator we implement closed loop reinforcement learning algorithms to determine which methods are most effective at learning effective acoustic neural stimulation strategies. Approach. By recording a comprehensive set of acoustic frequency presentations and neural responses from a set of animals we created a large database of neural responses to acoustic stimulation. Extensive electrical stimulation in the CN and the recording of neural responses in the IC provides a mapping of how the auditory system responds to electrical stimuli. The combined dataset is used as the foundation for the simulator, which is used to implement and test learning algorithms. Main results. Reinforcement learning, utilising a modified n-Armed Bandit solution, is implemented to demonstrate the model's function. We show the ability to effectively learn stimulation patterns which mimic the cochlea's ability to covert acoustic frequencies to neural activity. Time taken to learn effective replication using neural stimulation takes less than 20 min under continuous testing. Significance. These results show the utility of reinforcement learning in the field of neural stimulation. These results can be coupled with existing sound processing technologies to develop new auditory prosthetics that are adaptable to the recipients current auditory pathway. The same process can theoretically be abstracted to other sensory and motor systems to develop similar electrical replication of neural signals.