CycleGAN-based realistic image dataset generation for forward-looking sonar. (16th February 2021)

• Record Type: Journal Article
• Authors: Liu, Dingyu; Wang, Yusheng; Ji, Yonghoon; Tsuchiya, Hiroshi; Yamashita, Atsushi; Asama, Hajime
• Is Part Of: Advanced robotics. Volume 35:Number 3/4(2021)
• Page Start: 242
• Page End: 254
• Publication Date: 2021-02-16
• Subjects: Marine robotics -- forward-looking sonar -- acoustic image dataset -- realistic acoustic image generation -- CycleGAN; Robotics -- Periodicals; Robotics -- Japan -- Periodicals; Robotics; Japan; Periodicals; 629.89205
• DOI: 10.1080/01691864.2021.1873845
• Languages: English
• ISSNs: 0169-1864

Abstract

ABSTRACT: In this paper, we propose a novel method to generate realistic acoustic datasets for forward-looking sonars. A forward-looking sonar, which is also known as an acoustic camera, outperforms other imaging sensor when applied in underwater tasks as it can provide more accurate and detailed information about the environment, even in dark or turbid water. However, the difficulty and high cost of acquiring acoustic images in real experiments encourage researchers to consider the generation of simulated acoustic image datasets. In particular, deep learning-based methods demonstrated high performance in computer vision tasks, such as in object detection. However, a large dataset is necessary in most cases. In the proposed method, we first build a novel user-friendly acoustic image simulator based on 3D modeling software. Then, the CycleGAN is applied to generate realistic acoustic images based on the generated dataset from the simulator. The experimental results demonstrate that our method can generate effective and realistic acoustic datasets with relatively simple operations. GRAPHICAL ABSTRACT: UF0001