Reinforcement learning-based NMPC for tracking control of ASVs: Theory and experiments. (March 2022)

• Record Type: Journal Article
• Authors: Martinsen, Andreas B.; Lekkas, Anastasios M.; Gros, Sébastien
• Is Part Of: Control engineering practice. Volume 120(2022)
• Publication Date: 2022-03
• Subjects: Dynamic positioning -- Model predictive control -- Optimal control -- Reinforcement learning -- Surface vessels -- System identification -- Trajectory tracking; Automatic control -- Periodicals; 629.89
• DOI: 10.1016/j.conengprac.2021.105024
• Languages: English
• ISSNs: 0967-0661

Abstract

Abstract: We present a reinforcement learning-based (RL) model predictive control (MPC) method for trajectory tracking of surface vessels. The proposed method uses an MPC controller in order to perform both trajectory tracking and control allocation in real-time, while simultaneously learning to optimize the closed loop performance by using RL and system identification (SYSID) in order to tune the controller parameters. The efficiency of the method is evaluated by performing simulations on the unmanned surface vehicle (USV) ReVolt, as well as simulations and sea trials on the autonomous urban passengers ferry milliAmpere . Our results demonstrate that the proposed method is able to outperform other state of the art methods both in tracking performance, as well as energy efficiency.