A monocular vision positioning and tracking system based on deep neural network. Issue 3 (5th March 2023)

• Record Type: Journal Article
• Authors: Li, Huijun; Zhang, Yu; Ye, Bin; Zhao, Hailong
• Is Part Of: Journal of engineering. Volume 2023:Issue 3(2023)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2023-03-05
• Subjects: LibTorch -- neural networks -- target localization -- tracking -- YOLOv5; Engineering -- Periodicals; Engineering; Electronic journals; Periodicals; 620.005
• DOI: 10.1049/tje2.12246
• Languages: English
• ISSNs: 2051-3305

Abstract

Abstract: In order to locate the mobile robots in three‐dimensional indoor environment, mostly global navigation satellite system‐denied space, a monocular visual space positioning algorithm based on a deep neural network is proposed. First, the authors employ the lightweight YOLOv5 algorithm for target detection, and the LibTorch deep learning framework is used for model deployment to improve the inference speed. Moreover, a multi‐layer perceptron (MLP) neural network with four inputs and two outputs is constructed, which regress the site coordinates of the robot to complete the target localization, and this method is compared with the mathematical model solving algorithm to reflect the accuracy and superiority of positioning algorithm based on the deep neural network. The proposed positioning and tracking system has been successfully applied to international conference on robotics and automation (ICRA) robot competition, and the results show that the positioning mean error estimated by the authors' method is within 10 cm whilst having good real‐time performance. Abstract : This paper proposes a monocular visual positioning and tracking system based on the neural network. It uses the information obtained from target detection to establish multi‐layer perceptron (MLP) regression model to obtain the coordinates of the robot in the field, which can achieve better accuracy and speed for robot localization.