Multi‐level image representation for large‐scale image‐based instance retrieval. Issue 1 (29th March 2018)

• Record Type: Journal Article
• Authors: Deng, Qili; Wu, Shuai; Wen, Jie; Xu, Yong
• Is Part Of: CAAI transactions on intelligence technology. Volume 3:Issue 1(2018)
• Page Start: 33
• Page End: 39
• Publication Date: 2018-03-29
• Subjects: image retrieval -- learning (artificial intelligence) -- feature extraction -- image representation -- feedforward neural nets; multilevel image representation -- large‐scale image -- instance‐level‐image retrieval -- convolutional neural network -- image retrieval task -- effective feature encoder -- embedding step -- aggregation step -- multitask loss -- novel representation policy -- deep CNN -- multilevel‐image representation -- retrieval performance -- Alibaba large‐scale search challenge; B6135E Image recognition -- C5260B Computer vision and image processing techniques -- C5290 Neural computing techniques -- C6170K Knowledge engineering techniques -- C7250R Information retrieval techniques; Artificial intelligence -- Periodicals; Computer science -- Periodicals; Artificial intelligence; Computer science; Electronic journals; Periodicals; 006.305
• DOI: 10.1049/trit.2018.0003
• Languages: English
• ISSNs: 2468-6557

Abstract

Abstract : In recent years, instance‐level‐image retrieval has attracted massive attention. Several researchers proposed that the representations learned by convolutional neural network (CNN) can be used for image retrieval task. In this study, the authors propose an effective feature encoder to extract robust information from CNN. It consists of two main steps: the embedding step and the aggregation step. Moreover, they apply the multi‐task loss function to train their model in order to make the training process more effective. Finally, this study proposes a novel representation policy that encodes feature vectors extracted from different layers to capture both local patterns and semantic concepts from deep CNN. They call this 'multi‐level‐image representation', which could further improve the performance. The proposed model is helpful to improve the retrieval performance. For the sake of comprehensively evaluating the performance of their approach, they conducted ablation experiments with various convolutional NN architectures. Furthermore, they apply their approach to a concrete challenge – Alibaba large‐scale search challenge. The results show that their model is effective and competitive.