Feature fusion method using BoVW framework for enhancing image retrieval. Issue 11 (9th August 2019)

• Record Type: Journal Article
• Authors: Vimina, E. Ravindran; Jacob, K. Poulose
• Is Part Of: IET image processing. Volume 13:Issue 11(2019)
• Page Start: 1979
• Page End: 1985
• Publication Date: 2019-08-09
• Subjects: object recognition -- feature extraction -- image classification -- computer vision -- image fusion -- image retrieval -- image matching -- image colour analysis -- image enhancement -- edge detection; feature fusion method -- BoVW framework -- image retrieval -- bag‐of‐visual words -- recognition problems -- computer vision -- object recognition -- scene classification -- natural image datasets -- invariant descriptors -- BoVW models -- multicue fusion approach -- early fusion methods -- late fusion methods -- retrieval performance -- invariant feature descriptor SURF -- composite edge descriptor -- composite colour descriptor; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2018.5381
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : The bag‐of‐visual words (BoVW) has been applied to myriad of recognition problems in computer vision such as object recognition, scene classification and image retrieval due to its scalability and high precision. However, their performance is subservient in certain datasets, especially in natural image datasets, mainly due to the lack of consideration of image cues such as colour, texture etc. which are not prime features while computing invariant descriptors, on which BoVW models are generally built on. Hence, this study describes a multi‐cue fusion approach for BoVW framework, exploiting both early and late fusion methods, to improve the retrieval performance, mainly in natural image datasets. For this, a composite edge and colour descriptor is proposed to describe the local regions of the image along with the invariant feature descriptor Speeded Up Robust Features (SURF). Independent vocabularies are built based on these descriptors and images in the dataset are encoded to form two histograms using the respective vocabularies. The histograms are further fused to characterise the image. The retrieval is carried out by matching the histograms. Experimental results show that significant increment in the average precision can be attained by combining the proposed descriptor with invariant descriptors.