Reinforcement learning-based optimal complete water-blasting for autonomous ship hull corrosion cleaning system. (15th January 2021)

• Record Type: Journal Article
• Authors: Le, Anh Vu; Kyaw, Phone Thiha; Veerajagadheswar, Prabakaran; Muthugala, M.A. Viraj J.; Elara, Mohan Rajesh; Kumar, Madhu; Khanh Nhan, Nguyen Huu
• Is Part Of: Ocean engineering. Volume 220(2021)
• Publication Date: 2021-01-15
• Subjects: Ship maintenance industry -- Corrosion cleaning -- Benchmarking blasting quality -- Reinforcement learning -- Path planning; Ocean engineering -- Periodicals; Ocean engineering; Periodicals; 620.4162
• DOI: 10.1016/j.oceaneng.2020.108477
• Languages: English
• ISSNs: 0029-8018

Abstract

Abstract: Routine cleaning of the corroded ship hulls in dry dock maintenance guarantees the smooth operation of the shipping industry. Deploying the autonomous system to remove the corrosion by water-blasting is a feasible approach to ease the burden in manual operation and to reduce water, time, and energy consumption. In this paper, the water-blasting framework is proposed for a novel robot platform named Hornbill with the adhesion mechanism by permanent magnetic, self-localization by sensor fusion to navigate smoothly on a vertical surface. Hence, we propose a complete waypoint path planning (CWPP) to re-blast the self-synthesizing deep convolutional neural network (DCNN) based corrosion heatmap by initial-blasting. The optimal CWPP problem, including the shortest travel distance and shortest travel time to save water, power while ensuring visiting all predefined waypoints by benchmarking output, is modeled as the classic Travel Salesman Problem (TSP). Further, the Pareto-optimal trajectory for given TSP has been driven by the reinforcement learning (RL) technique with a proposed reward function based on the robot's operation during blasting. From the experimental results at the shipyard site, the proposed RL-based CWPP generates the Pareto-optimal trajectory that enables the water-blasting robot to spend about 10% of energy and 9% of water less than the second-best evolutionary-based optimization method in various workspaces. Highlights: Corroded ship hull cleaning by automatic system is proposed to save energy, water. The reconfigurable climbing robot can navigate autonomously on the hull surface. A DCNN based self-evaluating scheme benchmarks the cleaning efficiency. Optimal trajectory uses reinforcement learning with proposed reward function. The proposed framework saves about 10% and 9% the energy, water spent.