Training bidirectional generative adversarial networks with hints. (July 2020)

• Record Type: Journal Article
• Authors: Mutlu, Uras; Alpaydın, Ethem
• Is Part Of: Pattern recognition. Volume 103(2020:Jul.)
• Publication Date: 2020-07
• Subjects: Generative Modeling -- Generative Adversarial Networks -- Unsupervised Learning -- Autoencoders -- Neural Networks -- Deep Learning; 00-01 -- 99-00; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2020.107320
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: The BiGAN has an encoder, in addition to the generator and discriminator of GAN. This encoder coupled with the generator allows defining extra loss terms as hints. We experiment on five image data sets, MNIST, UT-Zap50K, GTSRB, Cifar10, and CelebA. With these different hints, BiGAN generates higher quality and more diverse images. Graphical abstract: Abstract: The generative adversarial network (GAN) is composed of a generator and a discriminator where the generator is trained to transform random latent vectors to valid samples from a distribution and the discriminator is trained to separate such "fake" examples from true examples of the distribution, which in turn forces the generator to generate better fakes. The bidirectional GAN (BiGAN) also has an encoder working in the inverse direction of the generator to produce the latent space vector for a given example. This added encoder allows defining auxiliary reconstruction losses as hints for a better generator. On five widely-used data sets, we showed that BiGANs trained with the Wasserstein loss and augmented with hints learn better generators in terms of image generation quality and diversity, as measured numerically by the 1-nearest neighbor test, Fréchet inception distance, and reconstruction error, and qualitatively by visually analyzing the generated samples.