Optimized GAN for Text-to-Image Synthesis: Hybrid Whale Optimization Algorithm and Dragonfly Algorithm. (November 2022)

• Record Type: Journal Article
• Authors: Talasila, Vamsidhar; M R, Narasingarao; V, Murali Mohan
• Is Part Of: Advances in engineering software. Volume 173(2022)
• Publication Date: 2022-11
• Subjects: Text-to-image -- Cross modal feature -- BI-LSTM -- Optimized GAN -- DC-WO Model; Computer-aided engineering -- Periodicals; Engineering -- Computer programs -- Periodicals; Engineering -- Software -- Periodicals; Periodicals; 620.0028553
• DOI: 10.1016/j.advengsoft.2022.103222
• Languages: English
• ISSNs: 0965-9978

Abstract

Highlights: This paper aims to design a new text-to-image synthesis scheme. Initially, throughout text to image encoding, cross modal feature grouping is done. BI-LSTM is employed for converting the text embeddings into text feature vectors. In the subsequent stage, the images are synthesized depending upon the encoding. The GAN is trained with optimization strategy by tuning optimal weights using DC-WO. Abstract: Text to image synthesizes is a motivating and valuable task to explore in these days. The objective is to produce images from texts or captions, i.e. considering textual descriptions as input and deploying them to produce related images. For carrying this task, two challenging elements of image generation and language modeling should be combined that are said to be more complex than caption generation. This research aims to develop a new text-to-image synthesis method that includes the two crucial steps of (i) text to picture encoding and (ii) optimized GAN. At first, cross-modal feature grouping is done throughout the text to image encoding. Consequently, text embeddings are transformed into textual feature vectors using BI-LSTM. The images are created based on the encoding in the following stage. Thus, optimized GAN receives input from text feature groups and outputs the end synthesis images. Here, a research plans to train the GAN with optimization strategy via tuning the optimal weights using the Dragon Customized Whale Optimization (DC-WO) model. Finally, the superiority of the created approach is evaluated by comparing it to existing techniques. Additionally, the FID value of the proposed model using the cub dataset is 29.04%, 47.43%, 49.09%, 37.64% and 11.35%, superior to traditional FF, WOA, GWO, DA and GAN + CMAF models.