Automatic seam detection and tracking system for robots based on laser vision. (November 2019)

• Record Type: Journal Article
• Authors: Zou, Yanbiao; Zhou, Weilin
• Is Part Of: Mechatronics. Volume 63(2019)
• Publication Date: 2019-11
• Subjects: Laser vision sensor -- Deep convolutional neural network -- Seam tracking -- Correlation filter; Computer integrated manufacturing systems -- Periodicals; Flexible manufacturing systems -- Periodicals; Mechatronics -- Periodicals; Productique -- Périodiques; Fabrication, Systèmes flexibles de -- Périodiques; Mécatronique -- Périodiques; Computer integrated manufacturing systems; Flexible manufacturing systems; Mechatronics; Periodicals; 629.89
• DOI: 10.1016/j.mechatronics.2019.102261
• Languages: English
• ISSNs: 0957-4158

Abstract

Highlights: The deep convolutional neural network is used to extract features of the target. The multi-correlation filter cooperative mechanism is proposed for seam detection. The proposed algorithm has been successfully validated with welding experiments. Abstract: Detecting weld seams and accurately locating them from time-series images that contain strong noise pollution are difficult and lead to reduced tracking accuracy. To address this problem, this paper presents a seam detection and tracking algorithm from the perspective of seam feature extraction and seam detection and positioning. The proposed image-processing algorithm employs the powerful feature expression capability and self-learning function of the deep convolutional neural network. A real-time weld seam searching and positioning strategy based on the multi-correlation filter cooperative detection mechanism is proposed in consideration of the continuity of the motion of the feature points of adjacent frames and the correlation of laser stripe structural information. Experimental results show that the sensor's measurement frequency can reach 20 Hz, the average absolute tracking error of straight or curved welds is less than 0.25 mm, and the maximum tracking error does not exceed 1 mm in an environment with strong arc and splash noise. Moreover, the welding torch end runs smoothly during welding. The proposed strategy can meet high-quality welding requirements.