Scene Understanding Based on High-Order Potentials and Generative Adversarial Networks. (5th August 2018)

• Record Type: Journal Article
• Authors: Zhao, Xiaoli; Wang, Guozhong; Zhang, Jiaqi; Zhang, Xiang
• Other Names: Huang Shih-Chia Academic Editor.
• Is Part Of: Advances in multimedia. Volume 2018(2018)
• Publication Date: 2018-08-05
• Subjects: Multimedia systems -- Periodicals; Computer networks -- Periodicals; Multimédia; Réseaux d'ordinateurs; Computer networks; Multimedia systems; Periodicals; 006.7
• DOI: 10.1155/2018/8207201
• Languages: English
• ISSNs: 1687-5680

Abstract

Abstract : Scene understanding is to predict a class label at each pixel of an image. In this study, we propose a semantic segmentation framework based on classic generative adversarial nets (GAN) to train a fully convolutional semantic segmentation model along with an adversarial network. To improve the consistency of the segmented image, the high-order potentials, instead of unary or pairwise potentials, are adopted. We realize the high-order potentials by substituting adversarial network for CRF model, which can continuously improve the consistency and details of the segmented semantic image until it cannot discriminate the segmented result from the ground truth. A number of experiments are conducted on PASCAL VOC 2012 and Cityscapes datasets, and the quantitative and qualitative assessments have shown the effectiveness of our proposed approach.