Generalizable model-agnostic semantic segmentation via target-specific normalization. (February 2022)

• Record Type: Journal Article
• Authors: Zhang, Jian; Qi, Lei; Shi, Yinghuan; Gao, Yang
• Is Part Of: Pattern recognition. Volume 122(2022)
• Publication Date: 2022-02
• Subjects: Domain generalization -- Semantic segmentation -- Model-agnostic learning -- Target-specific normalization; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2021.108292
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: The method is designed for the generalizable semantic segmentation task. The method trains model-agnostic model with meta learning. The method adapts to the testing domain with target-specific normalization. Image bank with the style-based selection policy obtains more accurate statistics. Abstract: Semantic segmentation in a supervised learning manner has achieved significant progress in recent years. However, its performance usually drops dramatically due to the data-distribution discrepancy between seen and unseen domains when we directly deploy the trained model to segment the images of unseen (or new coming) domains. To this end, we propose a novel domain generalization framework for the generalizable semantic segmentation task, which enhances the generalization ability of the model from two different views, including the training paradigm and the test strategy. Concretely, we exploit the model-agnostic learning to simulate the domain shift problem, which deals with the domain generalization from the training scheme perspective. Besides, considering the data-distribution discrepancy between seen source and unseen target domains, we develop the target-specific normalization scheme to enhance the generalization ability. Furthermore, when images come one by one in the test stage, we design the image-based memory bank (Image Bank in short) with style-based selection policy to select similar images to obtain more accurate statistics of normalization. Extensive experiments highlight that the proposed method produces state-of-the-art performance for the domain generalization of semantic segmentation on multiple benchmark segmentation datasets, i.e., Cityscapes, Mapillary.