Learning stereo disparity with feature consistency and confidence. (14th February 2022)

• Record Type: Journal Article
• Authors: Zhao, Liaoying; Li, Jiaming; Li, Jianjun; Wu, Yong; Cheng, Shichao; Tang, Zheng; Hui, Guobao; Chang, Chin-Chen
• Is Part Of: International journal of ad hoc and ubiquitous computing. Volume 39:Number 1/2(2022)
• Page Start: 83
• Page End: 92
• Publication Date: 2022-02-14
• Subjects: depth estimation -- stereo matching -- confidence measure -- feature consistency -- multi-distance metrics; Ubiquitous computing -- Periodicals; Embedded computer systems -- Periodicals; Electronic data processing -- Distributed processing -- Periodicals; Wireless communication systems -- Periodicals; Computer architecture -- Periodicals; 004.2
• Languages: English
• ISSNs: 1743-8225

Abstract

Most of the existing stereo matching methods have been formulated into four regular parts: feature extraction (FE), cost calculation (CC), cost aggregation (CA), and disparity refinement (DF). They can obtain high precision results in most regions through modifying parts of the four methods, but still have problems in some ill-posed regions. This paper focuses on feature consistency and confidence (FCC), discovers the new attributes of the feature, and proposes a novel neural network structure for stereo matching by measuring the consistency and confidence of features. Base on this method, the paper fuses the cost volume and calculates the pixel confidence map for cost calculation and cost aggregation. The experimental results show the proposed method outperforms most of the state-of-the-art methods on both SceneFlow and Kitti benchmarks and lowers the estimation error of stereo matching down to 1.82% ranking at the 7th position in the Kitti 2015 scoreboard six months ago (http://www.cvlibs.net/datasets/kitti/).