Image translation with dual‐directional generative adversarial networks. Issue 1 (5th February 2021)

• Record Type: Journal Article
• Authors: Ruan, Congcong; Yuan, Liuchun; Hu, Haifeng; Chen, Dihu
• Is Part Of: IET computer vision. Volume 15:Issue 1(2021)
• Page Start: 73
• Page End: 83
• Publication Date: 2021-02-05
• Subjects: Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/cvi2.12011
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract: Image‐to‐image translation is a class of vision and graphics problems where the goal is to learn the mapping between input images and output images. However, due to the unstable training and limited training samples, many existing GAN‐based works have difficulty in producing photo‐realistic images. Herein, dual‐directional generative adversarial networks are proposed, which consist of four adversarial networks, to produce images of high perceptual quality. In this framework, self‐reconstruction strategy is used to construct auxiliary sub‐networks, which impose more effective constraints on encoder‐generator pairs. Using this idea, this model can increase the use ratio of paired data conditioned on the same dataset and obtain well‐trained encoder‐generator pairs with the help of the proposed cross‐network skip connections. Moreover, the proposed framework not only produces realistic images but also addresses the problem where condition GAN produces sharp images containing many small, hallucinated objects. Training on multiple supervised datasets, convincing evidences are shown to prove that this model can achieve compelling results by latently learning a common feature representation. Qualitative and quantitative comparisons against other methods, demonstrate the effectiveness and superiority of the method.