A method of locating the 3D centers of retroreflectors based on deep learning. Issue 3 (19th January 2021)

• Record Type: Journal Article
• Authors: Zhang, BinBin; Zhang, Fumin; Qu, Xinghua
• Is Part Of: Industrial robot. Volume 48:Issue 3(2021)
• Page Start: 352
• Page End: 358
• Publication Date: 2021-01-19
• Subjects: Machine vision -- Metrology -- Neural networks; Robots, Industrial -- Periodicals; Machinery in the workplace -- Periodicals; 629.892
• DOI: 10.1108/IR-09-2020-0186
• Languages: English
• ISSNs: 0143-991X

Abstract

Abstract : Purpose: Laser-based measurement techniques offer various advantages over conventional measurement techniques, such as no-destructive, no-contact, fast and long measuring distance. In cooperative laser ranging systems, it's crucial to extract center coordinates of retroreflectors to accomplish automatic measurement. To solve this problem, this paper aims to propose a novel method. Design/methodology/approach: We propose a method using Mask RCNN (Region Convolutional Neural Network), with ResNet101 (Residual Network 101) and FPN (Feature Pyramid Network) as the backbone, to localize retroreflectors, realizing automatic recognition in different backgrounds. Compared with two other deep learning algorithms, experiments show that the recognition rate of Mask RCNN is better especially for small-scale targets. Based on this, an ellipse detection algorithm is introduced to obtain the ellipses of retroreflectors from recognized target areas. The center coordinates of retroreflectors in the camera coordinate system are obtained by using a mathematics method. Findings: To verify the accuracy of this method, an experiment was carried out: the distance between two retroreflectors with a known distance of 1, 000.109 mm was measured, with 2.596 mm root-mean-squar error, meeting the requirements of the coarse location of retroreflectors. Research limitations/implications: The research limitations/implications are as follows: (i) As the data set only has 200 pictures, although we have used some data augmentation methods such as rotating, mirroring and cropping, there is still room for improvement in the generalization ability of detection. (ii) The ellipse detection algorithm needs to work in relatively dark conditions, as the retroreflector is made of stainless steel, which easily reflects light. Originality/value: The originality/value of the article lies in being able to obtain center coordinates of multiple retroreflectors automatically even in a cluttered background; being able to recognize retroreflectors with different sizes, especially for small targets; meeting the recognition requirement of multiple targets in a large field of view and obtaining 3 D centers of targets by monocular model-based vision.