Hyperfusion-Net: Hyper-densely reflective feature fusion for salient object detection. (September 2019)

• Record Type: Journal Article
• Authors: Zhang, Pingping; Liu, Wei; Lei, Yinjie; Lu, Huchuan
• Is Part Of: Pattern recognition. Volume 93(2019:Sep.)
• Page Start: 521
• Page End: 533
• Publication Date: 2019-09
• Subjects: Salient object detection -- Image reflection separation -- Multiple feature fusion -- Convolutional Neural Network; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2019.05.012
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: The HyperFusion-Net is proposed to learn complementary reflective features in the fusion view. A hyper-dense fusion method is proposed to integrate the global and local multi-scale features. The proposed method can capture clear object boundaries and spatially consistent saliency. State-of-the-art performance on seven challenging large-scale saliency benchmarks is achieved. Abstract: Salient Object Detection (SOD), which aims to find the most important region of interest and segment the relevant objects/items in that region, is an important yet challenging task in computer vision and image processing. This vision problem is inspired by the fact that human perceives the main scene elements with high priorities. Thus, accurate detection of salient objects in complex scenes is critical for human-computer interaction. In this paper, we present a novel reflective feature learning framework, which results in high detection accuracy while maintaining a compact model design. The proposed framework utilizes a hyper-densely reflective feature fusion network (named HyperFusion-Net ) to automatically predict the most important area and segment the associated objects in an end-to-end manner. Specifically, inspired by the human perception system and image reflection separation, we first decompose the input images into reflective image pairs by content-preserving transforms. Then, the complementary information of reflective image pairs is jointly extracted by an Interweaved Convolutional Neural Network (ICNN) and hierarchically combined with a hyper-dense fusion mechanism. Based on the fused multi-scale features, our method finally achieves a promising way of predicting salient objects, in which we cast the SOD as a pixel-wise classification problem. Extensive experiments on seven public datasets demonstrate that the proposed method consistently outperforms other state-of-the-art methods with a large margin.