Research on autonomous collision avoidance of merchant ship based on inverse reinforcement learning. (11th November 2020)

• Record Type: Journal Article
• Authors: Zheng, Mao; Xie, Shuo; Chu, Xiumin; Zhu, Tianquan; Tian, Guohao
• Is Part Of: International journal of advanced robotic systems. Volume 17:Number 6(2020:Nov./Dec.)
• Publication Date: 2020-11-11
• Subjects: Inverse reinforcement learning -- collision avoidance -- cross entropy -- projection -- merchant ship; Robotics -- Periodicals; Robotics; Periodicals; 629.892
• DOI: 10.1177/1729881420969081
• Languages: English
• ISSNs: 1729-8806

Abstract

To learn the optimal collision avoidance policy of merchant ships controlled by human experts, a finite-state Markov decision process model for ship collision avoidance is proposed based on the analysis of collision avoidance mechanism, and an inverse reinforcement learning (IRL) method based on cross entropy and projection is proposed to obtain the optimal policy from expert's demonstrations. Collision avoidance simulations in different ship encounters are conducted and the results show that the policy obtained by the proposed IRL has a good inversion effect on two kinds of human experts, which indicate that the proposed method can effectively learn the policy of human experts for ship collision avoidance.