Learning across views for stereo image completion. Issue 7 (14th October 2020)

• Record Type: Journal Article
• Authors: Ma, Wei; Zheng, Mana; Ma, Wenguang; Xu, Shibiao; Zhang, Xiaopeng
• Is Part Of: IET computer vision. Volume 14:Issue 7(2020)
• Page Start: 482
• Page End: 492
• Publication Date: 2020-10-14
• Subjects: stereo image processing -- image segmentation -- learning (artificial intelligence) -- convolutional neural nets -- image fusion; convolutional neural network layers -- stereo‐interactive completion -- cross‐view consistent completion -- stereo image completion -- single image repairing -- deep learning -- single‐view coherent -- X‐shaped fully convolutional network -- SICNet -- fusion module; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/iet-cvi.2019.0775
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract : Stereo image completion (SIC) is to fill holes existing in a pair of stereo images. SIC is more complicated than single image repairing, which needs to complete the pair of images while keeping their stereoscopic consistency. In recent years, deep learning has been introduced into single image repairing but seldom used for SIC. The authors present a novel deep learning‐based approach for SIC. In their method, an X‐shaped fully convolutional network (called SICNet) is proposed and designed to complete stereo images, which is composed of two branches of convolutional neural network layers to encode the context of the left and right images separately, a fusion module for stereo‐interactive completion, and two branches of decoders to produce completed left and right images, respectively. In consideration of both inter‐view and intra‐view cues, they introduce auxiliary networks and define comprehensive losses to train SICNet to perform single‐view coherent and cross‐view consistent completion simultaneously. Extensive experiments are conducted to show the state‐of‐the‐art performances of the proposed approach and its key components.