Multi-layer graph constraints for interactive image segmentation via game theory. (July 2016)

• Record Type: Journal Article
• Authors: Wang, Tao; Sun, Quansen; Ji, Zexuan; Chen, Qiang; Fu, Peng
• Is Part Of: Pattern recognition. Volume 55(2016:Jul.)
• Page Start: 28
• Page End: 44
• Publication Date: 2016-07
• Subjects: Image segmentation -- Superpixel -- Multi-layer graph -- Nonparametric learning -- Game theory; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2016.01.018
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: The combination of pixels and superpixels has been widely used for image segmentation, where the pixels and superpixels are segmented together. These combination methods can obtain more robust results by using more informative superpixel features. However, since the superpixel may not accurately capture the details for the small and slender regions, the results of these combination methods are often label inconsistent with the objects. Furthermore, these methods also fall into expensive time cost due to introducing more interactions between pixels and superpixels. To overcome the above problems, in this paper, we propose an interactive image segmentation method based on multi-layer graph constraints. The relationships between pixels/superpixels and labels are introduced into the conventional combination framework to further improve the segmentation accuracy. The segmentation model is constructed based on the estimation of probabilities of pixels and superpixels by a nonparametric learning framework. Then the probabilities of pixels and superpixels are updated iteratively by utilizing the game theory based optimization strategy. Experiments on challenging data sets demonstrate that the proposed method can obtain better segmentation results than the state-of-the-art methods. Highlights: Multi-layer graph constraints are utilized for the interactive image segmentation. Labeling information is introduced into the conventional pixel–superpixel combinational model. The optimization based on game theory is proposed for the combinational energy functions. The proposed method can obtain better performance than the state-of-the-art methods.