Robust depth enhancement based on texture and depth consistency. Issue 1 (1st February 2018)

• Record Type: Journal Article
• Authors: Chang, Ting‐An; Liao, Wei‐Chen; Yang, Jar‐Ferr
• Is Part Of: IET signal processing. Volume 12:Issue 1(2018)
• Page Start: 119
• Page End: 128
• Publication Date: 2018-02-01
• Subjects: image resolution -- image texture -- image matching -- stereo image processing -- three‐dimensional television -- image enhancement; robust depth enhancement -- texture consistency -- depth consistency -- three‐dimension television technology -- 3DTV technology -- 3DTV broadcasting -- stereo matching -- RGB‐D camera -- high resolution texture image -- similarity‐based hole filling -- texture similarity‐based depth enhancement -- rotating counsel depth refinement -- object boundary -- depth enhancement methods; Signal processing -- Periodicals; 621.3822
• DOI: 10.1049/iet-spr.2016.0550
• Languages: English
• ISSNs: 1751-9675

Abstract

Abstract : With advances in three‐dimension television (3DTV) technology, accurate depth information for 3DTV broadcasting has gained much attention recently. The depth map, either retrieved by stereo matching or captured by the RGB‐D camera, is mostly with lower resolution and often with noisy or missing values than the texture frame. How to effectively utilise high‐resolution texture image to enhance the corresponding depth map becomes an important and inevitable approach. In this study, the authors propose texture similarity‐based hole filling, texture similarity‐based depth enhancement and rotating counsel depth refinement to enhance the depth map. Thus, the proposed depth enhancement system could suppress the noise, fill the holes and sharpen the object edges simultaneously. Experimental results demonstrate that the proposed system provides a superior performance, especially around the object boundary comparing to the state‐of‐the‐art depth enhancement methods.