RGBD Scene Flow Estimation with Global Nonrigid and Local Rigid Assumption. (29th June 2020)

• Record Type: Journal Article
• Authors: Li, Xiuxiu; Liu, Yanjuan; Jin, Haiyan; Cai, Lei; Zheng, Jiangbin
• Other Names: Li Longzhuang Guest Editor.
• Is Part Of: Discrete dynamics in nature and society. Volume 2020(2020)
• Publication Date: 2020-06-29
• Subjects: System analysis -- Periodicals; Dynamics -- Periodicals; Chaotic behavior in systems -- Periodicals; Differentiable dynamical systems -- Periodicals; 003.05
• DOI: 10.1155/2020/8215389
• Languages: English
• ISSNs: 1026-0226

Abstract

Abstract : RGBD scene flow has attracted increasing attention in the computer vision with the popularity of depth sensor. To estimate the 3D motion of object accurately, a RGBD scene flow estimation method with global nonrigid and local rigid motion assumption is proposed in this paper. Firstly, the preprocessing is implemented, which includes the colour-depth registration and depth image inpainting, to processing holes and noises in the depth image; secondly, the depth image is segmented to obtain different motion regions with different depth values; thirdly, scene flow is estimated based on the global nonrigid and local rigid assumption and spatial-temporal correlation of RGBD information. In the global nonrigid and local rigid assumption, each segmented region is divided into several blocks, and each block has a rigid motion. With this assumption, the interaction of motion from different parts in the same segmented region is avoided, especially the nonrigid object, e.g., a human body. Experiments are implemented on RGBD tracking dataset and deformable 3D reconstruction dataset. The visual comparison shows that the proposed method can distinguish the motion parts from the static parts in the same region better, and the quantitative comparisons proved more accurate scene flow can be obtained.