Deep quantization generative networks. (September 2020)

• Record Type: Journal Article
• Authors: Wan, Diwen; Shen, Fumin; Liu, Li; Zhu, Fan; Huang, Lei; Yu, Mengyang; Shen, Heng Tao; Shao, Ling
• Is Part Of: Pattern recognition. Volume 105(2020:Sep.)
• Publication Date: 2020-09
• Subjects: Compression -- Acceleration -- Generative models -- Network quantization; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2020.107338
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: This is a pioneering work exploring quantization to accelerate and compress deep convolutional generation models. Analyses and experiments suggest the importance of maintaining sufficient information for activation quantization. The proposed deep quantization generative network (DQGN) quantizes both network weights and activations to low-bits. Experiments on VAEs, GANs, style transfer, and super-resolution demonstrate the effectiveness of the proposed DQGN. Abstract: Equipped with powerful convolutional neural networks (CNNs), generative models have achieved tremendous success in various vision applications. However, deep generative networks suffer from high computational and memory costs in both model training and deployment. While many efforts have been devoted to accelerate discriminative models by quantization, effectively reducing the costs for deep generative models is more challenging and remains unexplored. In this work, we investigate applying quantization technology to deep generative models. We find that keeping as much information as possible for quantized activations is key to obtain high-quality generative models. With this in mind, we propose Deep Quantization Generative Networks (DQGNs) to effectively accelerate and compress deep generative networks. By expanding the dimensions of the quantization basis space, DQGNs can achieve lower quantization error and are highly adaptive to complex data distributions. Various experiments on two powerful frameworks ( i.e ., variational auto-encoders, and generative adversarial networks) and two practical applications ( i.e ., style transfer, and super-resolution) demonstrate our findings and the effectiveness of our proposed approach.