Collaborative discriminative multi-metric learning for facial expression recognition in video. (March 2018)

• Record Type: Journal Article
• Authors: Yan, Haibin
• Is Part Of: Pattern recognition. Volume 75(2018:Mar.)
• Page Start: 33
• Page End: 40
• Publication Date: 2018-03
• Subjects: Facial expression recognition -- Multi-metric learning -- Collaborative learning -- Video-based -- Multi-view learning; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2017.02.031
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We present a new metric learning approach for facial expression recognition in videos. Our approach combines both audio and visual features and achieves better facial expression recognition performance. Experimental results clearly show the advantages of the proposed approach over the state-of-the-arts. Abstract: Facial expression recognition in video has been an important and relatively new topic in human face analysis and attracted growing interests in recent years. Unlike conventional image-based facial expression recognition methods which recognize facial expression category from still images, facial expression recognition in video is more challenging because there are usually larger intra-class variations among facial frames within a video. This paper presents a collaborative discriminative multi-metric learning (CDMML) for facial expression recognition in video. We first compute multiple feature descriptors for each face video to describe facial appearance and motion information from different aspects. Then, we learn multiple distance metrics with these extracted multiple features collaboratively to exploit complementary and discriminative information for recognition. Experimental results on the Acted Facial Expression in Wild (AFEW) 4.0 and the extended Cohn–Kanada (CK+) datasets are presented to demonstrate the effectiveness of our proposed method.