A Comprehensive Survey of Image Augmentation Techniques for Deep Learning. (May 2023)

• Record Type: Journal Article
• Authors: Xu, Mingle; Yoon, Sook; Fuentes, Alvaro; Park, Dong Sun
• Is Part Of: Pattern recognition. Volume 137(2023)
• Publication Date: 2023-05
• Subjects: Image augmentation -- Deep learning -- Image variation -- Vicinity distribution -- Data augmentation -- Computer vision; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2023.109347
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We examine challenges and vicinity distribution to demonstrate the necessity of image augmentation for deep learning. We present a comprehensive survey on image augmentation with a novel informative taxonomy that encompasses a wider range of algorithms. We discuss the current situation and future direction for image augmentation, along with three relevant topics: understanding image augmentation, new strategy to leverage image augmentation, and feature augmentation. Abstract: Although deep learning has achieved satisfactory performance in computer vision, a large volume of images is required. However, collecting images is often expensive and challenging. Many image augmentation algorithms have been proposed to alleviate this issue. Understanding existing algorithms is, therefore, essential for finding suitable and developing novel methods for a given task. In this study, we perform a comprehensive survey of image augmentation for deep learning using a novel informative taxonomy. To examine the basic objective of image augmentation, we introduce challenges in computer vision tasks and vicinity distribution. The algorithms are then classified among three categories: model-free, model-based, and optimizing policy-based. The model-free category employs the methods from image processing, whereas the model-based approach leverages image generation models to synthesize images. In contrast, the optimizing policy-based approach aims to find an optimal combination of operations. Based on this analysis, we believe that our survey enhances the understanding necessary for choosing suitable methods and designing novel algorithms.