Semantic-based conditional generative adversarial hashing with pairwise labels. (July 2023)

• Record Type: Journal Article
• Authors: Li, Qi; Wang, Weining; Tang, Yuanyan; Xu, Chengzhong; Sun, Zhenan
• Is Part Of: Pattern recognition. Volume 139(2023)
• Publication Date: 2023-07
• Subjects: Generative adversarial networks -- Semantic-based conditional information -- Hashing with pairwise labels; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2023.109452
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A general two-stage cGANs framework is proposed to learn hash codes based on the pairwise label information. In the first stage, the conditional information is generated via a general Bayesian framework, which has several advantages over traditional methods. The first advantage is that it preserves semantic information of original data samples. Besides, it can be represented by a much lower dimensional vector, which is much more flexible than other representations. In order to utilize both labeled and unlabeled data samples, a simple semi-supervised conditional generative adversarial hashing method is presented in the second stage. Both pairwise-based cross entropy loss and adversarial loss are introduced to make full use of these data samples. We conduct extensive experiments to verify the effectiveness of our method. The results on three benchmark datasets have shown the superiority of our method. Abstract: Hashing has been widely exploited in recent years due to the rapid growth of image and video data on the web. Benefiting from recent advances in deep learning, deep hashing methods have achieved promising results with supervised information. However, it is usually expensive to collect the supervised information. In order to utilize both labeled and unlabeled data samples, many semi-supervised hashing methods based on Generative Adversarial Networks (GANs) have been proposed. Most of them still need the conditional information, which is usually generated by the pre-trained neural networks or leveraging random binary vectors. One natural question about these methods is that how can we generate a better conditional information given the semantic similarity information? In this paper, we propose a general two-stage conditional GANs hashing framework based on the pairwise label information. Both the labeled and unlabeled data samples are exploited to learn hash codes under our framework. In the first stage, the conditional information is generated via a general Bayesian approach, which has a much lower dimensional representation and maintains the semantic information of original data samples. In the second stage, a semi-supervised approach is presented to learn hash codes based on the conditional information. Both pairwise based cross entropy loss and adversarial loss are introduced to make full use of labeled and unlabeled data samples. Extensive experiments have shown that the propose algorithm outperforms current state-of-the-art methods on three benchmark image datasets, which demonstrates the effectiveness of our method.