Influence of image classification accuracy on saliency map estimation. Issue 3 (3rd September 2018)

• Record Type: Journal Article
• Authors: Oyama, Taiki; Yamanaka, Takao
• Is Part Of: CAAI transactions on intelligence technology. Volume 3:Issue 3(2018)
• Page Start: 140
• Page End: 152
• Publication Date: 2018-09-03
• Subjects: computer vision -- image classification; MIT1003 -- OSIE -- PASCAL‐S -- up‐sampling layer -- ImageNet -- computer vision -- image classification -- saliency‐map resolution -- multiscale images; (B6135) Optical, image and video signal processing -- (C5260B) Computer vision and image processing techniques; Artificial intelligence -- Periodicals; Computer science -- Periodicals; Artificial intelligence; Computer science; Electronic journals; Periodicals; 006.305
• DOI: 10.1049/trit.2018.1012
• Languages: English
• ISSNs: 2468-6557

Abstract

Abstract : Saliency map estimation in computer vision aims to estimate the locations where people gaze in images. Since people tend to look at objects in images, the parameters of the model pre‐trained on ImageNet for image classification are useful for the saliency map estimation. However, there is no research on the relationship between the image classification accuracy and the performance of the saliency map estimation. In this study, it is shown that there is a strong correlation between image classification accuracy and saliency map estimation accuracy. The authors also investigated the effective architecture based on multi‐scale images and the up‐sampling layers to refine the saliency‐map resolution. The model achieved the state‐of‐the‐art accuracy on the PASCAL‐S, OSIE, and MIT1003 datasets. In the MIT saliency benchmark, the model achieved the best performance in some metrics and competitive results in the other metrics.