Discriminative feature fusion for RGB-D salient object detection. (March 2023)

• Record Type: Journal Article
• Authors: Chen, Zeyu; Zhu, Mingyu; Chen, Shuhan; Lu, Lu; Tang, Haonan; Hu, Xuelong; Ji, Chunfan
• Is Part Of: Computers & electrical engineering. Volume 106(2023)
• Publication Date: 2023-03
• Subjects: RGB-D salient object detection -- Discriminative feature fusion -- Multi-scale contextual perception -- Multimodal feature fusion; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2023.108579
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: RGB-D salient object detection aims to separate salient object from an image aided by depth. While a number of effective approaches have been proposed, difficulties still exist, which is due to two challenges: (1) It is difficult to fully and effectively fuse RGB and depth features especially in challenging scenes; (2) How to enhance the semantic information of low-level feature and enrich the spatial information of high-level feature. Most of the existing approaches design separate modules to address them. In this paper, a unified discriminative feature fusion module is proposed to be used for both multimodal and multiscale feature fusion. The module can also increase the semantic information in low-level features and enrich the spatial information in high-level features. A multi-scale contextual perception module is embedded in the network to accurately localize objects at different scales. Unlike other methods, the depth branch in the network uses pure convolution for complementary feature extraction. This paper conducted a comparison with 14 state-of-the-art methods on 8 datasets, and the experimental results suggest that the proposed approach is more effective and superior.