Immersive and interactive cyber-physical system (I2CPS) and virtual reality interface for human involved robotic manufacturing. (January 2022)

• Record Type: Journal Article
• Authors: Yun, Huitaek; Jun, Martin B.G.
• Is Part Of: Journal of manufacturing systems. Volume 62(2022)
• Page Start: 234
• Page End: 248
• Publication Date: 2022-01
• Subjects: Smart manufacturing -- Cyber-physical system (CPS) -- Virtual reality -- Robotic manufacturing -- Middleware; Manufacturing processes -- Periodicals; Production engineering -- Data processing -- Periodicals; Robots, Industrial -- Periodicals; Production, Technique de la -- Informatique -- Périodiques; Robots industriels -- Périodiques; Electronic journals; 670.42
• DOI: 10.1016/j.jmsy.2021.11.018
• Languages: English
• ISSNs: 0278-6125

Abstract

Highlights: Immersive and interactive cyber-physical system (I 2 CPS) framework for collaboration between human, autonomy, and physical systems. Middleware and data-to-operation protocol were combined to communicate information with the wide range of contexts. A new interface with virtual reality to provide the collaborative environment for augmenting human skills and autonomy. Abstract: Smart manufacturing promotes the demand of new interfaces for communication with autonomies such as big data analysis, digital twin, and self-decisive control. Collaboration between human and the autonomy becomes imperative factor for improving productivity. However, current human-machine interfaces (HMI) such as 2D screens or panels require human knowledge of process and long-term experience to operate, which is not intuitive for beginning workers or is designed to work with the autonomy. This study proposes a human interface framework of cyber-physical system (CPS) based on virtual reality, named as immersive and interactive CPS (I 2 CPS), to create an interface for human-machine-autonomy collaboration. By combination of data-to-information protocol and middleware, MTConnect and Robot Operating System (ROS), heterogeneous physical systems were integrated with virtual assets such as digital models, digital shadows, and virtual traces of human works in the virtual reality (VR) based interface. All the physical and virtual assets were integrated in the interface that human, autonomy, and physical system can collaborate. Applying constraints in the VR interface and deploying virtual human works to industrial robots were demonstrated to verify the effectiveness of the I 2 CPS framework, showing collaboration between human and autonomy: augmentation of human skills by autonomy and virtual robot teaching to generate automatic robot programs.