Deep collaborative graph hashing for discriminative image retrieval. (July 2023)

• Record Type: Journal Article
• Authors: Zhang, Zheng; Wang, Jianning; Zhu, Lei; Luo, Yadan; Lu, Guangming
• Is Part Of: Pattern recognition. Volume 139(2023)
• Publication Date: 2023-07
• Subjects: Deep hashing -- Image retrieval -- Collaborative learning -- Graph convolutional hashing -- Semantic encoding; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2023.109462
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: The multi-level semantic interaction, common latent space construction, and structural similarity preservation are jointly considered in a collaborative deep hashing framework. A dual-stream deep learning architecture is formulated to collectively capture the visual and semantic features, yielding discriminative hash codes. Multiple supervisions are explored from the perspectives of the point-wise, pairwise, and reformulated semantics. Abstract: The most striking success of deep hashing for large-scale image retrieval benefits from its powerful discriminative representation of deep learning and the attractive computational efficiency of compact hash code learning. Most existing deep semantic-preserving hashing regard the available semantic labels as the ground truth for classification or transform them into prevalent pairwise similarities. However, such strategies fail to capture the interactive correlations between the visual semantics embedded in images and the given category-level labels. Moreover, they utilize the fixed piecewise or pairwise semantics as the optimization objectives, which suffers from the limited flexibility on semantic representation and adaptive knowledge communication in hash code learning. In this paper, we propose a novel Deep Collaborative Graph Hashing (DCGH), which collectively considers multi-level semantic embeddings, latent common space construction, and intrinsic structure mining in discriminative hash codes learning, for large-scale image retrieval. To the best of our knowledge, this is the first collaborative graph hashing for image retrieval. Specifically, instead of using the conventional single-flow visual network architecture, we design a dual-stream feature encoding network to jointly explore the multi-level semantic information across visual and semantic features. Moreover, a well-established shared latent space is constructed based on space reconstruction to explore the concurrent information and bridge the semantic gap between visual and semantic space. Furthermore, a graph convolutional network is introduced to preserve the latent structural relations in the optimal pairwise similarity-preserving hash codes. The whole learning framework is optimized in an end-to-end fashion. Extensive experiments on different datasets demonstrate that our DCGH can achieve superb image retrieval performance against state-of-the-art supervised hashing methods. The source codes of the proposed DCGH are available at https://github.com/JalinWang/DCGH .