Data-driven distributed formation control of under-actuated unmanned surface vehicles with collision avoidance via model-based deep reinforcement learning. (1st January 2023)

• Record Type: Journal Article
• Authors: Pan, Chao; Peng, Zhouhua; Liu, Lu; Wang, Dan
• Is Part Of: Ocean engineering. Volume 267(2023)
• Publication Date: 2023-01-01
• Subjects: Unmanned surface vehicles -- Model-based deep reinforcement learning -- Distributed formation control -- Collision avoidance; Ocean engineering -- Periodicals; Ocean engineering; Periodicals; 620.4162
• DOI: 10.1016/j.oceaneng.2022.113166
• Languages: English
• ISSNs: 0029-8018

Abstract

Abstract: This paper addresses the distributed formation control with collision avoidance for multiple under-actuated unmanned surface vehicles (USVs) subject to fully unknown models. A fully data-driven distributed control approach is proposed for multiple USVs to achieve a desired formation based on model-based deep reinforcement learning. Specifically, a deep neural network is firstly trained to approximate the dynamic model of each USV by utilizing recorded input and output data. Then, by taking collision avoidance requirements into account, the model predictive formation controllers are proposed for USVs to achieve the safe formation control task based on the learned vehicle dynamics. It is shown that after learning with offline and online data, the proposed fully data-driven distributed controllers are able to achieve a safe formation. Simulations results are given to substantiate the feasibility and efficacy of the proposed model-based deep reinforcement learning method for distributed formation control of under-actuated USVs with fully unknown models. Highlights: A distributed formation control with collision avoidance for USVs. A deep network is trained to approximate the dynamic model of each USV. The model predictive controllers are proposed to achieve the safe formation control.