Multi-EmoNet: A Novel Multi-Task Neural Network for Driver Emotion Recognition. Issue 5 (2020)

• Record Type: Journal Article
• Authors: Cui, Yaodong; Ma, Yintao; Li, Wenbo; Bian, Ning; Li, Guofa; Cao, Dongpu
• Is Part Of: IFAC-PapersOnLine. Volume 53:Issue 5(2020)
• Page Start: 650
• Page End: 655
• Publication Date: 2020
• Subjects: Emotion Recognition -- Facial Expression Recognition -- Intelligent Vehicle -- Deep learning -- Pattern Recognition; Automatic control -- Periodicals; 629.805
• DOI: 10.1016/j.ifacol.2021.04.155
• Languages: English
• ISSNs: 2405-8963

Abstract

Abstract: Driver's emotion affects driving safety Hu et al. (2013), therefore monitoring driver's emotion could benefit road safety. However, the complex illumination conditions in a vehicle cockpit significantly challenge the effectiveness of camera-based facial expression recognition (FER) systems. To solve this problem, we proposed Multi-EmoNet, a novel multi-task neural network, to classify human facial expression under illumination variations and to restore noisy images. Our experiments demonstrate these two tasks are complementary and together facilitate better network representation learning. Our approach obtains significantly better classification accuracy on images with illumination variation compared to the baseline networks. More importantly, the proposed multi-task network is a general architecture that can be applied to any noise involved image classification problem.