A spatial information inference method for programming by demonstration of assembly tasks by integrating visual observation with CAD model. Issue 5 (3rd June 2020)

• Record Type: Journal Article
• Authors: Zhou, Zhongxiang; Ji, Liang; Xiong, Rong; Wang, Yue
• Is Part Of: Assembly automation. Volume 40:Issue 5(2020)
• Page Start: 689
• Page End: 701
• Publication Date: 2020-06-03
• Subjects: Assembly tasks -- CAD model -- Programming by demonstration -- Spatial information inference; Automation -- Periodicals; Automatic machinery -- Periodicals; Assembly-line methods -- Periodicals; Industrial engineering -- Periodicals; 670.42705
• DOI: 10.1108/AA-06-2019-0101
• Languages: English
• ISSNs: 0144-5154

Abstract

Abstract : Purpose: In robot programming by demonstration (PbD) of small parts assembly tasks, the accuracy of parts poses estimated by vision-based techniques in demonstration stage is far from enough to ensure a successful execution. This paper aims to develop an inference method to improve the accuracy of poses and assembly relations between parts by integrating visual observation with computer-aided design (CAD) model. Design/methodology/approach: In this paper, the authors propose a spatial information inference method called probabilistic assembly graph with optional CAD model, shorted as PAGC*, to achieve this task. Then an assembly relation extraction method from CAD model is designed, where different assembly relation descriptions in CAD model are summarized into two fundamental relations that are colinear and coplanar. The relation similarity, distance similarity and rotation similarity are adopted as the similar part matching criterions between the CAD model and the observation. The knowledge of part in CAD is used to correct that of the corresponding part in observation. The likelihood maximization estimation is used to infer the accurate poses and assembly relations based on the probabilistic assembly graph. Findings: In the experiments, both simulated data and real-world data are applied to evaluate the performance of the PAGC* model. The experimental results show the superiority of PAGC* in accuracy compared with assembly graph (AG) and probabilistic assembly graph without CAD model (PAG). Originality/value: The paper provides a new approach to get the accurate pose of each part in demonstration stage of the robot PbD system. By integrating information from visual observation with prior knowledge from CAD model, PAGC* ensures the success in execution stage of the PbD system.