Two-dimensional subspace alignment for convolutional activations adaptation. (November 2017)

• Record Type: Journal Article
• Authors: Lu, Hao; Cao, Zhiguo; Xiao, Yang; Zhu, Yanjun
• Is Part Of: Pattern recognition. Volume 71(2017:Nov.)
• Page Start: 320
• Page End: 336
• Publication Date: 2017-11
• Subjects: Visual domain adaptation -- Subspace alignment -- Convolutional activations -- Two-dimensional PCA -- Domain divergence measure; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2017.06.010
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Two-dimensional subspace alignment (2DSA) is proposed for domain adaptation. The classification performance has low correlation to domain discrepancy measure. Local within- and between-class divergences are introduced to compare domains. A novel domain adaptation application in agriculture is illustrated. A MTFS3-DA dataset with 10 domains is developed for cross-field evaluation. Abstract: In real-world computer vision applications, many intrinsic and extrinsic variations can cause a significant domain shift. Although deep convolutional models have provided us with better domain-invariant features, existing mechanisms to adapt convolutional activations are still limited. Notice that convolutional activations are intrinsically represented as tensors, in this paper we develop a two-dimensional subspace alignment (2DSA) approach based on 2D principal component analysis (PCA) to better adapt convolutional activations. Extensive experiments demonstrate the advantages of 2DSA over its counterpart SA in both effectiveness and efficiency. In particular, when trying to explain why 2DSA works well, we find that the best classification performance has low correlation with the global domain discrepancy measure. In an effort to find a better way to compare domains, we introduce within- and between-class domain divergence measures to characterize the class-level differences. The proposed measures somewhat shed light on what a good alignment might be for classification. Furthermore, we also demonstrate a novel domain adaptation application in agriculture and create a dataset for the problem.