Robust Feature Detection for Facial Expression Recognition. (26th July 2007)

• Record Type: Journal Article
• Authors: Ioannou, Spiros; Caridakis, George; Karpouzis, Kostas; Kollias, Stefanos
• Other Names: Ostermann Jörn Academic Editor.
• Is Part Of: EURASIP journal on image and video processing. Volume 2007(2007)
• Publication Date: 2007-07-26
• Subjects: Image processing -- Digital techniques -- Periodicals; Digital video -- Periodicals; Traitement d'images; Vidéo numérique; Digital video; Image processing -- Digital techniques; Periodicals; Electronic journal; Electronic journals; 621.367
• DOI: 10.1155/2007/29081
• Languages: English
• ISSNs: 1687-5176

Abstract

Abstract : This paper presents a robust and adaptable facial feature extraction system used for facial expression recognition in human-computer interaction (HCI) environments. Such environments are usually uncontrolled in terms of lighting and color quality, as well as human expressivity and movement; as a result, using a single feature extraction technique may fail in some parts of a video sequence, while performing well in others. The proposed system is based on a multicue feature extraction and fusion technique, which provides MPEG-4-compatible features assorted with a confidence measure. This confidence measure is used to pinpoint cases where detection of individual features may be wrong and reduce their contribution to the training phase or their importance in deducing the observed facial expression, while the fusion process ensures that the final result regarding the features will be based on the extraction technique that performed better given the particular lighting or color conditions. Real data and results are presented, involving both extreme and intermediate expression/emotional states, obtained within the sensitive artificial listener HCI environment that was generated in the framework of related European projects.