3D driver pose estimation based on joint 2D–3D network. Issue 3 (29th January 2020)

• Record Type: Journal Article
• Authors: Yao, Zhijie; Liu, Yazhou; Ji, Zexuan; Sun, Quansen; Lasang, Pongsak; Shen, Shengmei
• Is Part Of: IET computer vision. Volume 14:Issue 3(2020)
• Page Start: 84
• Page End: 91
• Publication Date: 2020-01-29
• Subjects: driver information systems -- pose estimation -- feature extraction -- cameras; private driver data -- joint 2D–3D network -- three-dimensional driver pose estimation -- computer–human interaction -- convolutional neural networks -- infrared image -- point cloud -- time-of-flight camera -- 2D–3D network incorporating image-based; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/iet-cvi.2019.0089
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract : Three‐dimensional (3D) driver pose estimation is a promising and challenging problem for computer–human interaction. Recently convolutional neural networks have been introduced into 3D pose estimation, but these methods have the problem of slow running speed and are not suitable for driving scenario. In this study, the proposed method is based on two types of inputs, infrared image and point cloud obtained from time‐of‐flight camera. The authors propose a joint 2D–3D network incorporating image‐based and point‐based feature to promote the performance of 3D human pose estimation and run on a high speed. For point cloud with invalid points, the authors first do preprocess and then design a denoising module to handle this problem. Experiments on private driver data set and public Invariant‐Top View data set show that the proposed method achieves efficient and competitive performance on 3D human pose estimation.