A generative model approach for visualising convolutional neural networks. (2018)

• Record Type: Journal Article
• Authors: Kobayashi, Masayuki; Suganuma, Masanori; Nagao, Tomoharu
• Is Part Of: International journal of computational intelligence studies. Volume 7:Number 3/4(2018)
• Page Start: 214
• Page End: 230
• Publication Date: 2018
• Subjects: convolutional neural network -- CNN -- generative adversarial networks -- GAN -- visualisation -- activation maximisation -- interpretability; Computational intelligence -- Periodicals; 006.305
• Languages: English
• ISSNs: 1755-4985

Abstract

Convolutional neural networks (CNN) have continued to achieve outstanding performance in a variety of computer vision tasks. CNNs have advanced significantly deeper and deeper, continuing to show substantial improvements for various tasks. Despite their successes, their models are often considered as black-box predictors, and their uninterpretable natures are major problems. In this paper, we introduce a new visualisation framework based on generative adversarial networks (GAN) to provide insight into how CNNs work. Following the standard GAN training, we train the generator and the discriminator to produce natural images that activate a particular unit in the pre-trained CNN. We apply our method to the AlexNet and CaffeNet and visualise the neuron activations. Our method is very simple, yet produces comparatively recognisable visualisations. We also attempt to use our visualisation as indications of models trust and verify the potential of our visualisations.