Class structure‐aware adversarial loss for cross‐domain human action recognition. Issue 14 (10th July 2021)

• Record Type: Journal Article
• Authors: Chen, Wanjun; Liu, Long; Lin, Guangfeng; Chen, Yajun; Wang, Jing
• Is Part Of: IET image processing. Volume 15:Issue 14(2021)
• Page Start: 3425
• Page End: 3432
• Publication Date: 2021-07-10
• Subjects: Image processing -- Periodicals; 621.36705
• DOI: 10.1049/ipr2.12309
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract: Cross‐domain action recognition is a challenging vision task due to the domain shift and the absence of labeled data in the target domain. With only labelled source domain and unlabelled target domain data during training, some existing methods rely on an adversarial framework to align the features from different domains to a common latent space. However, the existing adversarial‐based approaches have a major limitation of only attempting to perform the alignment from a holistic view, ignoring the underlying coherence of class structure across domains. A class structure‐aware adversarial loss (CSCAL) is presented to address this issue. The CSCAL incorporates the category information into the adversarial learning branch to capture the fine‐grained alignment of each class, effectively avoiding the false mixup of samples from different categories in the embedding space. Experiments on HMDB51, UCF101 and Olympic Sports datasets show significant improvement compared to the baseline. Code and trained model can be found at https://github.com/bregmangh/CSCAL .