Learning a deep network with spherical part model for 3D hand pose estimation. (August 2018)

• Record Type: Journal Article
• Authors: Chen, Tzu-Yang; Ting, Pai-Wen; Wu, Min-Yu; Fu, Li-Chen
• Is Part Of: Pattern recognition. Volume 80(2018:Aug.)
• Page Start: 1
• Page End: 20
• Publication Date: 2018-08
• Subjects: Hand detection -- Hand pose estimation -- Deep learning -- Convolutional neural network -- Spherical part model; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.02.029
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A novel vision-based framework for 3D hand pose estimation is proposed. A spherical Part Model is proposed to transform the joint locations to an explicit representation. The dataset is expanded by rotating the original images every 45°. Abstract: Hand pose estimation is a hot topic in recent years. It has been widely used in virtual reality since it provides an interface for communication between human and cyberspace. Hand pose estimation is difficult due to some challenges. First, we need to detect human hand which is very changeable. Second, the high degree of freedom leads to difficulties in pose estimation. In this paper, we aim to build a hand pose estimation system which can correctly detect human hand and estimate its pose. We design a model called spherical part model (SPM) and train a deep convolutional neural network using this model. As a result, our network can more accurately estimate hand pose based on prior knowledge of human hand. To demonstrate it, a complete experiment is conducted on two public and one self-build datasets. The results show that our system can outperform other state of the art works.