ASPW-DRL: assembly sequence planning for workpieces via a deep reinforcement learning approach. Issue 1 (23rd August 2019)

• Record Type: Journal Article
• Authors: Zhao, Minghui; Guo, Xian; Zhang, Xuebo; Fang, Yongchun; Ou, Yongsheng
• Is Part Of: Assembly automation. Volume 40:Issue 1(2020)
• Page Start: 65
• Page End: 75
• Publication Date: 2019-08-23
• Subjects: Automatic assembly -- Assembly sequence planning; Automation -- Periodicals; Automatic machinery -- Periodicals; Assembly-line methods -- Periodicals; Industrial engineering -- Periodicals; 670.42705
• DOI: 10.1108/AA-11-2018-0211
• Languages: English
• ISSNs: 0144-5154

Abstract

Abstract : Purpose: This paper aims to automatically plan sequence for complex assembly products and improve assembly efficiency. Design/methodology/approach: An assembly sequence planning system for workpieces (ASPW) based on deep reinforcement learning is proposed in this paper. However, there exist enormous challenges for using DRL to this problem due to the sparse reward and the lack of training environment. In this paper, a novel ASPW-DQN algorithm is proposed and a training platform is built to overcome these challenges. Findings: The system can get a good decision-making result and a generalized model suitable for other assembly problems. The experiments conducted in Gazebo show good results and great potential of this approach. Originality/value: The proposed ASPW-DQN unites the curriculum learning and parameter transfer, which can avoid the explosive growth of assembly relations and improve system efficiency. It is combined with realistic physics simulation engine Gazebo to provide required training environment. Additionally with the effect of deep neural networks, the result can be easily applied to other similar tasks.