Time-coherent 3D animation reconstruction from RGB-D video. Issue 4 (April 2016)

• Record Type: Journal Article
• Authors: Ahmed, Naveed; Khalifa, Salam
• Is Part Of: Signal, image and video processing. Volume 10:Issue 4(2016)
• Page Start: 783
• Page End: 790
• Publication Date: 2016-04
• Subjects: 3D video -- 3D animation -- RGB-D video -- Temporally coherent 3D animation; Signal processing -- Digital techniques -- Periodicals; Image processing -- Digital techniques -- Periodicals; Digital video -- Periodicals; 621.3822
• DOI: 10.1007/s11760-015-0813-1
• Languages: English
• ISSNs: 1863-1703

Abstract

Abstract We present a new method to reconstruct a time-coherent 3D animation from RGB-D video data using unbiased feature point sampling. Given RGB-D video data, in the form of a 3D point cloud sequence, our method first extracts feature points using both color and depth information. Afterward, these feature points are used to match two 3D point clouds in consecutive frames independent of their resolution. Our new motion vector-based dynamic alignment method then fully reconstructs a spatio-temporally coherent 3D animation. We perform extensive quantitative validation using a novel error function, in addition to the standard techniques in the literature, and compared our method to existing methods in the literature. We show that despite the limiting factors of temporal and spatial noise associated to RGB-D data, it is possible to extract temporal coherence to faithfully reconstruct a temporally coherent 3D animation from RGB-D video data.