A self-aware and active-guiding training & assistant system for worker-centered intelligent manufacturing. (August 2019)

• Record Type: Journal Article
• Authors: Tao, Wenjin; Lai, Ze-Hao; Leu, Ming C.; Yin, Zhaozheng; Qin, Ruwen
• Is Part Of: Manufacturing letters. Volume 21(2019)
• Page Start: 45
• Page End: 49
• Publication Date: 2019-08
• Subjects: Intelligent manufacturing -- Deep learning -- Augmented reality -- Cyber-physical system -- Smart manufacturing; Manufacturing industries -- Periodicals; Production engineering -- Periodicals; Manufacturing industries; Periodicals; 670
• DOI: 10.1016/j.mfglet.2019.08.003
• Languages: English
• ISSNs: 2213-8463

Abstract

Abstract: Training and on-site assistance is critical to help workers master required skills, improve worker productivity, and guarantee the product quality. Traditional training methods lack worker-centered considerations that are particularly in need when workers are facing ever-changing demands. In this study, we propose a worker-centered training & assistant system for intelligent manufacturing, which is featured with self-awareness and active-guidance. Multi-modal sensing techniques are applied to perceive each individual worker and a deep learning approach is developed to understand the worker's behavior and intention. Moreover, an object detection algorithm is implemented to identify the parts/tools the worker is interacting with. Then the worker's current state is inferred and used for quantifying and assessing the worker performance, from which the worker's potential guidance demands are analyzed. Furthermore, onsite guidance with multi-modal augmented reality is provided actively and continuously during the operational process. Two case studies are used to demonstrate the feasibility and great potential of our proposed approach and system for applying to the manufacturing industry for frontline workers.