Goal-directed autonomous navigation of mobile robot based on the principle of neuromodulation. (2nd October 2019)

• Record Type: Journal Article
• Authors: Wang, Dongshu; Si, Wenjie; Luo, Yong; Wang, Heshan; Ma, Tianlei
• Is Part Of: Network. Volume 30:Number 1/4(2019)
• Page Start: 79
• Page End: 106
• Publication Date: 2019-10-02
• Subjects: Robot navigation -- developmental network -- reinforcement learning -- serotonin -- dopamine; Neural computers -- Periodicals; Neural networks (Computer science) -- Periodicals; 006.32
• DOI: 10.1080/0954898X.2019.1668575
• Languages: English
• ISSNs: 0954-898X

Abstract

ABSTRACT: Autonomous navigation in dynamic environment is aprerequisite of the mobile robot to perform tasks, and numerous approaches have been presented, including the supervised learning. Using supervised learning in robot navigation might meet problems, such as inconsistent and noisy data, and high error in training data. Inspired by the advantages of the reinforcement learning, such as no need for desired outputs, many researchers have applied reinforcement learning to robot navigation. This paper presents anovel method to address the robot navigation in different settings, through integrating supervised learning and analogical reinforcement learning into amotivated developmental network. We focus on the effect of the new learning rate on the robot navigation behavior. Experimentally, we show that the effect of internal neurons on the learning rate allows the agent to approach the target and avoid the obstacle as compounding effects of sequential states in static, dynamic, and complex environments. Further, we compare the performance between the emergent developmental network system and asymbolic system, as well as other four reinforcement learning algorithms. These experiments indicate that the reinforcement learning is beneficial for developing desirable behaviors in this set of robot navigation– staying statistically close to its target and away from obstacle.