Facial performance illumination transfer from a single video using interpolation in non‐skin region. (3rd May 2013)

• Record Type: Journal Article
• Authors: Wu, Hongyu; Chen, Xiaowu; Yang, Mengxia; Fang, Zhihong
• Is Part Of: Computer animation and virtual worlds. Volume 24:Number 3/4(2013)
• Page Start: 255
• Page End: 263
• Publication Date: 2013-05-03
• Subjects: illumination transfer -- facial performance -- single video -- propagation -- interpolation; Computer animation -- Periodicals; Visualization -- Periodicals; 006.6
• DOI: 10.1002/cav.1519
• Languages: English
• ISSNs: 1546-4261

Abstract

ABSTRACT: This paper proposes a novel video‐based method to transfer the illumination from a single reference facial performance video to a target one taken under nearly uniform illumination. We first filter the key frames of the reference and the target face videos with an edge‐preserving filter. Then, the illumination component of reference key frame is extracted through dividing the filtered reference key frames by the corresponding filtered target key frames in skin region. The differences in non‐skin region caused by different expressions between the reference and target face may bring about artifacts. Therefore, we interpolate the illumination component of the non‐skin region by that of the surrounded skin region to ensure the spatial smoothness and consistency. After that, the illumination components of key frames are propagated to non‐key frames to ensure the temporal consistency between the two adjacent frames. We obtain convincing results by transferring the illumination effects of a single reference facial performance video to a target one with the spatial and temporal consistencies preserved. Copyright © 2013 John Wiley & Sons, Ltd. Abstract : This paper proposes a novel video‐based method to transfer the illumination from a single reference facial performance video to a target one taken under nearly uniform illumination. We use an edge‐preserving filter and illumination component interpolation in non‐skin region to ensure the spatial smoothness and consistency of illumination component. The illumination components of key frames are propagated to non‐key frames to ensure the temporal consistency between the two adjacent frames of illumination component.