A contextual sensor system for non-intrusive machine status and energy monitoring. (January 2022)

• Record Type: Journal Article
• Authors: Ren, Yutian; Li, Guann-Pyng
• Is Part Of: Journal of manufacturing systems. Volume 62(2022)
• Page Start: 87
• Page End: 101
• Publication Date: 2022-01
• Subjects: Smart manufacturing -- Cyber physical systems -- Industrial IoT -- Worker machine interaction -- Energy disaggregation -- Context awareness; Manufacturing processes -- Periodicals; Production engineering -- Data processing -- Periodicals; Robots, Industrial -- Periodicals; Production, Technique de la -- Informatique -- Périodiques; Robots industriels -- Périodiques; Electronic journals; 670.42
• DOI: 10.1016/j.jmsy.2021.11.010
• Languages: English
• ISSNs: 0278-6125

Abstract

Highlights: A methodology to build a contextual sensor system with prior human and documented knowledge. Modeling the human–machine interactions in manufacturing as a correlated finite state machine. Monitoring status and energy consumptions of components in machines with a power meter and camera. System validation in semiconductor fabrication machines with or without automation control. Abstract: Event-driven contexts in manufacturing occur pervasively as a result of interactions among involved entities such as machines, workers, materials, and environment. One of the primary tasks in smart manufacturing is to derive a context-aware system conveniently incorporating worker knowledge for generating timely actionable intelligence for workers on factory floor and supervisors to respond. In this paper, we propose to design a human-and-machine interaction recognition framework by using a causality concept to collect contextual data for classifications of normal and abnormal machine operations. The causes and effects are between workers and machines for this initial research. To apply the causality to recognize worker interactions, initially a reliable way to identify the states of machines is necessary. The proposed contextual sensor system, consisting of a power meter for measuring machine operation conditions, a visual camera for capturing worker and machine interactions via a finite state machine model, and an algorithm for determining power signatures of individual components via energy disaggregation is implemented on semiconductor fabrication machines (manual or PLC controlled) each with multiple components. The experiment results demonstrate its context extraction capability such as components states and their corresponding energy usage in real time as well as its ability to identify anomalous operation conditions.