BoSR: A CNN-based aurora image retrieval method. (August 2019)

• Record Type: Journal Article
• Authors: Yang, Xi; Wang, Nannan; Song, Bin; Gao, Xinbo
• Is Part Of: Neural networks. Volume 116(2019)
• Page Start: 188
• Page End: 197
• Publication Date: 2019-08
• Subjects: Bag of salient regions -- Circular fisheye lens -- Aurora image retrieval; Neural computers -- Periodicals; Neural networks (Computer science) -- Periodicals; Neural networks (Neurobiology) -- Periodicals; Nervous System -- Periodicals; Ordinateurs neuronaux -- Périodiques; Réseaux neuronaux (Informatique) -- Périodiques; Réseaux neuronaux (Neurobiologie) -- Périodiques; Neural computers; Neural networks (Computer science); Neural networks (Neurobiology); Periodicals; 006.32
• DOI: 10.1016/j.neunet.2019.04.012
• Languages: English
• ISSNs: 0893-6080

Abstract

Abstract: The deep learning models especially the CNN have achieved amazing performance on natural image retrieval. However, remote sensing images captured with anamorphic lens are still retrieved via manual selection or traditional SIFT-based methods. How to leverage the advanced CNN models for remote sensing image retrieval is a new task of significance. This paper focuses on the aurora images captured with all-sky-imagers (ASI). By analyzing the imaging principle of ASI and characteristics of aurora, a salient region determination (SRD) scheme is proposed and embedded into the Mask R-CNN framework. Thus, we can regard an image as a "bag" of salient regions (BoSR). In practice, each salient region is represented with a CNN feature extracted from the SRD embedded Mask R-CNN. After clustered to generate a visual vocabulary, each CNN feature is quantized to its nearest center for indexing. In the stage of online retrieval, by computing the similarity scores between query image and all images in the dataset, ranking results can be obtained and image with the highest value is exported as the top rank. Extensive experiments are conducted on the big aurora data, and the results demonstrate that the proposed method improves the retrieval accuracy and efficiency.