Evaluation of 5G-capable framework for highly mobile, scalable human-machine interfaces in cyber-physical production systems. (July 2022)

• Record Type: Journal Article
• Authors: Mertes, Jan; Lindenschmitt, Daniel; Amirrezai, Masoud; Tashakor, Nima; Glatt, Moritz; Schellenberger, Christian; Shah, Swati Matwankar; Karnoub, Ali; Hobelsberger, Christopher; Yi, Li; Götz, Stefan; Aurich, Jan C.; Schotten, Hans D.
• Is Part Of: Journal of manufacturing systems. Volume 64(2022)
• Page Start: 578
• Page End: 593
• Publication Date: 2022-07
• Subjects: Human-machine interface -- Framework -- 5G -- Human-centricity -- CPPS -- Brain-computer interface; Manufacturing processes -- Periodicals; Production engineering -- Data processing -- Periodicals; Robots, Industrial -- Periodicals; Production, Technique de la -- Informatique -- Périodiques; Robots industriels -- Périodiques; Electronic journals; 670.42
• DOI: 10.1016/j.jmsy.2022.08.009
• Languages: English
• ISSNs: 0278-6125

Abstract

Abstract: Human cyber-physical production systems (HCPS) - as an extension of cyber-physical production systems (CPPS) - focus on the human being in the system and the development of socio-technical systems. Humans and therefore anthropogenic behavior have to be integrated into the manufacturing system and its processes. Due to the shift towards customized products, CPPS require high reconfigurability, flexibility and individual manufacturing processes. As a result, the role of and requirements for humans are fundamentally changing, creating the necessity for new interfaces to interact with machines within reconfigurable manufacturing process. Scalable human machine interfaces (HMI) are needed that incorporate emerging technologies as well as allowing mobility for the operator while interacting with different machines. Therefore, new approaches for HMI in the context of CPPS and HCPS are needed, which are simultaneously sufficiently mobile, scalable, and modular as well as human centered. High mobility of HMIs can be ensured by using the 5G communication standard that enables wireless migration of computational resources to an edge server with high reliability, low latency, and high data rates. This paper develops, implements, and evaluates a 5G-based, framework for highly mobile, scalable HMI in CPPS by utilizing the new 5G communication technology. The capabilities of the framework and of the new communication standard are demonstrated and evaluated for a use case, where a brain-computer interface (BCI) is used to control a robot arm. For better accuracy, the BCI is supported by an eye tracker and visual feedback is received via an augmented reality environment, and all devices are embedded via 5G communication. In particular, the influence of 5G communication on the system performance is examined, evaluated, and discussed. For this purpose, experiments are designed and conducted with different network configurations. Highlights: A framework for modular human-machine interfaces is developed, implemented, and evaluated. The communication technology is the new 5G communication standard allowing offloading of all processes to an edge server. 5G-capable, gaze-supported brain-computer interface is developed to control a robot arm and an augmented reality environment. 5G performance is tested, confirming 5G to be sufficiently performant to offload all processes. The implemented framework leads to less wiring, space savings, centralized maintenance, and thus cost savings.