A consistently fast and accurate algorithm for estimating camera pose from point correspondences. (February 2021)

• Record Type: Journal Article
• Authors: Yu, Qida; Xu, Guili; Zhang, Limao; Shi, Jiachen
• Is Part Of: Measurement. Volume 172(2021)
• Publication Date: 2021-02
• Subjects: Computer vision -- Absolute camera pose -- Three-dimensional measurements -- Perspective-n-Point (PnP) -- Gröbner basis; Weights and measures -- Periodicals; Measurement -- Periodicals; Measurement; Weights and measures; Periodicals; 530.8
• DOI: 10.1016/j.measurement.2020.108914
• Languages: English
• ISSNs: 0263-2241

Abstract

Abstract: This paper presents an accurate and simultaneously efficient algorithm for the Perspective-n-Point (PnP) problem that estimates the absolute pose of a fully-calibrated camera from given 3D-to-2D point correspondences. Previous works typically use the depth of each 3D point to formulate the PnP problem, which will bring extra variables. In contrast, the presented algorithm does not involve any depth factor. By introducing the Cayley–Gibbs–Rodriguez (CGR) parameterization, the modified formulation is first compressed to a nonlinear least-square cost function that only depends on three unknown rotation parameters and a known symmetric coefficient matrix. The Gröbner basis method is then adopted to find a set of solutions for the rotation parameters by solving a third-order polynomial system arising from the first-order optimality conditions of the cost function. Lastly, the rotation and translation are efficiently computed by back-substitution. Furthermore, a novel approach is developed for handling singularities of the CGR parameterization. It is improved by applying fixed pre-rotations, as opposed to randomly generated rotations in previous works, to 3D points. This improvement will facilitate the calculation of the coefficient matrix involved in a cost function when re-solving the PnP problem. Extensive experiments on both simulated and real data demonstrate that the presented algorithm can achieve the state-of-the-art accuracy with reduced computational requirements. Highlights: A compact derivation is given for the PnP problem. A novel strategy is developed to avoid singularities of Cayley parameterization. The proposed method has high accuracy and efficiency.