Salient object detection of social images based on semantic tag context. (2017)

• Record Type: Journal Article
• Authors: Liang, Ye; Lang, Congyan; Yu, Jian; Liu, Hongzhe
• Is Part Of: International journal of sensor networks. Volume 23:Number 4(2017)
• Page Start: 233
• Page End: 247
• Publication Date: 2017
• Subjects: saliency -- salient object detection -- social images -- tags; Sensor networks -- Periodicals; 681.2
• Languages: English
• ISSNs: 1748-1279

Abstract

Salient object detection is an important process for machines to understand visual contents as humans. Typically, most previous studies on salient object detection infer salient map by only using the visual features. In this paper, we propose a new paradigm on salient object detection, which aims at producing more reliable results by mining the context information from user's annotated tags. To address this problem, we firstly construct a large scale salient object dataset, which includes 5429 images from the NUSWIDE dataset (a real world web image database from National University of Singapore) with tag information and accurate human-labeled masks. Moreover, a specialised conditional random field (CRF) model is also proposed which takes account of both tag contexts and appearance cues. Extensive experiments show the effectiveness and superiority of our model which can accurately locate the salient objects.