Multiview‐coherent disocclusion synthesis using connected regions optimization. (27th May 2019)

• Record Type: Journal Article
• Authors: Li, Ping; Jin, Yuxi; Sheng, Bin; Lin, Di; Nie, Yongwei; Wu, Enhua
• Is Part Of: Computer animation and virtual worlds. Volume 30:Number 3/4(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2019-05-27
• Subjects: coherent -- connected regions -- disocclusion synthesis -- multiview; Computer animation -- Periodicals; Visualization -- Periodicals; 006.6
• DOI: 10.1002/cav.1894
• Languages: English
• ISSNs: 1546-4261

Abstract

Abstract: Handling of missing areas is a key step for depth‐based rendering to synthesize virtual views. Existing methods usually consider finding candidate pixels from only one reference view to fill missing areas. However, the information provided by one reference view is restricted by the position of the view. By utilizing two reference views located on both the left and right sides of the virtual view, we propose to synthesize the missing areas at hole level with connected regions optimization. To avoid the appearance of ghost boundary, we apply morphological operations to generate a boundary band map for the depth map, which restricts the warping of the virtual view. We use a binary map to mark unknown pixels in a hole, label the connected unknown regions, and count the area of each connected region, which decide the order in our enhanced inpainting synthesis. Besides, we separate the foreground and background regions of the depth map to constrain the searching of candidate pixels. Multiple experiments on virtual view synthesis have shown the effectiveness and high quality of our multiview‐coherent disocclusion synthesis. Abstract : We present a multiview‐coherent disocclusion synthesis using a connected‐regions optimization approach. We propose to synthesize the missing areas at hole level with connected regions utilizing two reference views located on both the left and right sides of the virtual view. Multiple experiments on virtual view synthesis have shown the effectiveness and high quality of our multiview‐coherent disocclusion synthesis.