Data augmentation using image-to-image translation for detecting forest strip roads based on deep learning. Issue 1 (2nd January 2021)

• Record Type: Journal Article
• Authors: Usui, Kengo
• Is Part Of: International journal of forest engineering. Volume 32:Issue 1(2021)
• Page Start: 57
• Page End: 66
• Publication Date: 2021-01-02
• Subjects: Autonomous forestry machinery -- deep convolutional neural network -- GAN-based data augmentation -- road detection -- semantic segmentation; Forestry engineering -- Periodicals; Génie forestier -- Périodiques; Forestry engineering; Periodicals; 634.905
• DOI: 10.1080/14942119.2021.1831426
• Languages: English
• ISSNs: 1913-2220

Abstract

ABSTRACT: Having been developed recently, image classification and object detection by deep convolutional neural networks are now widely used. However, in applications of deep learning in forestry, hardly any cases have involved forestry robots. For the autonomous driving and working of a forwarder on a strip road, a system is developed for detecting strip roads by semantic segmentation using deep learning, and data augmentation methods are proposed on the basis of generative adversarial networks (GANs) to improve robustness. In this study, three GAN-based data augmentation methods are proposed, namely, (i) translated images from new label images, (ii) translated images from an actual dataset, and (iii) both. The training dataset is evaluated by fully convolutional networks, from which the trained models show a pixel accuracy of 0.616 and a mean accuracy of 0.512. Compared with no augmentation and general augmentation, a maximum improvement in accuracy of 0.031 is observed. The GAN-based augmentation technique is effective for detecting a small number class because the class distribution of the dataset is set arbitrarily. Accurate detection by the trained model is confirmed even if the image dataset contains unknown obstacles.