Data‐driven recovery of hand depth using CRRF on stereo images. Issue 5 (23rd March 2018)

• Record Type: Journal Article
• Authors: Basaru, Rilwan Remilekun; Child, Chris; Alonso, Eduardo; Slabaugh, Gregory
• Is Part Of: IET computer vision. Volume 12:Issue 5(2018)
• Page Start: 666
• Page End: 678
• Publication Date: 2018-03-23
• Subjects: image matching -- cameras -- image segmentation -- pose estimation -- stereo image processing -- image classification -- regression analysis; hand depth -- CRRF -- stereo images -- hand pose -- important interface -- human–computer interaction -- data-driven method -- high-quality depth map -- stereoscopic camera input -- novel superpixel -- regression framework -- depth surface -- conditional regressive random forest -- conditional random field -- CRF -- RRF -- stereo red image pair -- green image pair -- blue image pair -- depth image -- different stereo-matching measures -- depth prediction -- pairwise interactions -- adjacent superpixels -- inexpensive stereo camera; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/iet-cvi.2017.0227
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract : Hand pose is emerging as an important interface for human–computer interaction. This study presents a data‐driven method to estimate a high‐quality depth map of a hand from a stereoscopic camera input by introducing a novel superpixel‐based regression framework that takes advantage of the smoothness of the depth surface of the hand. To this end, the authors introduce conditional regressive random forest (CRRF), a method that combines a conditional random field (CRF) and an RRF to model the mapping from a stereo red, green and blue image pair to a depth image. The RRF provides a unary term that adaptively selects different stereo‐matching measures as it implicitly determines matching pixels in a coarse‐to‐fine manner. While the RRF makes depth prediction for each superpixel independently, the CRF unifies the prediction of depth by modelling pairwise interactions between adjacent superpixels. Experimental results show that CRRF can generate a depth image more accurately than the leading contemporary techniques using an inexpensive stereo camera.