A deep Coarse-to-Fine network for head pose estimation from synthetic data. (October 2019)

• Record Type: Journal Article
• Authors: Wang, Yujia; Liang, Wei; Shen, Jianbing; Jia, Yunde; Yu, Lap-Fai
• Is Part Of: Pattern recognition. Volume 94(2019:Oct.)
• Page Start: 196
• Page End: 206
• Publication Date: 2019-10
• Subjects: Head pose estimation -- Coarse-to-Fine -- Joint learning; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2019.05.026
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Estimating head pose with a Coarse-to-Fine neural network. The network is achieved by joint learning, and thus are computationally efficient. Design a rendering pipeline to synthesize realistic head images with annotations. The generated head pose dataset contains 310k images. Abstract: Various applications of human-computer interaction are based on the estimation of head pose, which is challenging due to different facial appearance, inhomogeneous illumination, partial occlusion, etc. In this paper, we propose a deep neural network following the Coarse-to-Fine strategy to estimate head poses. The scheme includes two branches: Coarse classification phase classifying the input image into four categories, and Fine Regression phase estimating the accurate pose parameters. The two sub-networks are trained jointly. To tackle the problem of insufficient annotated data in training process, we design a rendering pipeline to synthesize realistic head images and generate an annotated dataset with a collection of 310 k head poses. The results on benchmark datasets and synthetic dataset validate the effectiveness of our approach, as well as the results on images with diverse illumination, occlusion, and motion blur. Moreover, our method can be easily extended to estimate head poses on depth images.