4D video textures for interactive character appearance. (1st June 2014)

• Record Type: Journal Article
• Authors: Casas, Dan; Volino, Marco; Collomosse, John; Hilton, Adrian
• Is Part Of: Computer graphics forum. Volume 33:Number 2(2014)
• Page Start: 371
• Page End: 380
• Publication Date: 2014-06-01
• Subjects: Categories and Subject Descriptors (according to ACM CCS): -- I.3.7 [Computer Graphics]: Three‐Dimensional Graphics and Realism—; Computer graphics -- Periodicals; 006.605
• DOI: 10.1111/cgf.12296
• Languages: English
• ISSNs: 0167-7055

Abstract

Abstract: 4D Video Textures (4DVT) introduce a novel representation for rendering video‐realistic interactive character animation from a database of 4D actor performance captured in a multiple camera studio. 4D performance capture reconstructs dynamic shape and appearance over time but is limited to free‐viewpoint video replay of the same motion. Interactive animation from 4D performance capture has so far been limited to surface shape only. 4DVT is the final piece in the puzzle enabling video‐realistic interactive animation through two contributions: a layered view‐dependent texture map representation which supports efficient storage, transmission and rendering from multiple view video capture; and a rendering approach that combines multiple 4DVT sequences in a parametric motion space, maintaining video quality rendering of dynamic surface appearance whilst allowing high‐level interactive control of character motion and viewpoint. 4DVT is demonstrated for multiple characters and evaluated both quantitatively and through a user‐study which confirms that the visual quality of captured video is maintained. The 4DVT representation achieves >90% reduction in size and halves the rendering cost.