Lip-Synching Using Speaker-Specific Articulation, Shape and Appearance Models. (15th November 2009)

• Record Type: Journal Article
• Authors: Bailly, Gérard; Govokhina, Oxana; Elisei, Frédéric; Breton, Gaspard
• Other Names: Fagel Sascha Academic Editor.
• Is Part Of: EURASIP journal on audio, speech, and music processing. Volume 2009(2009)
• Publication Date: 2009-11-15
• Subjects: Sound -- Recording and reproducing -- Digital techniques -- Periodicals; Computer sound processing -- Periodicals; Computer sound processing; Sound -- Recording and reproducing -- Digital techniques; Periodicals; Electronic journal; Electronic journals; 620.2
• DOI: 10.1155/2009/769494
• Languages: English
• ISSNs: 1687-4714

Abstract

Abstract : We describe here the control, shape and appearance models that are built using an original photogrammetric method to capture characteristics of speaker-specific facial articulation, anatomy, and texture. Two original contributions are put forward here: the trainable trajectory formation model that predicts articulatory trajectories of a talking face from phonetic input and the texture model that computes a texture for each 3D facial shape according to articulation. Using motion capture data from different speakers and module-specific evaluation procedures, we show here that this cloning system restores detailed idiosyncrasies and the global coherence of visible articulation. Results of a subjective evaluation of the global system with competing trajectory formation models are further presented and commented.