A local–global transformer for distributed monitoring of multi-unit nonlinear processes. (February 2023)

• Record Type: Journal Article
• Authors: Yi, Yongshuai; Zhao, Haitao; Hu, Zhengwei; Peng, Jingchao
• Is Part Of: Journal of process control. Volume 122(2023)
• Page Start: 13
• Page End: 26
• Publication Date: 2023-02
• Subjects: Fault detection -- Fault location -- Distributed monitoring -- Attention mechanism -- Transformer encoder; Process control -- Periodicals; Fabrication -- Contrôle -- Périodiques; Process control; Periodicals; Electronic journals; 660.281
• DOI: 10.1016/j.jprocont.2022.12.007
• Languages: English
• ISSNs: 0959-1524

Abstract

Abstract: Nonlinear modeling of modern industrial processes with multi-unit, large-scale characteristics is very challenging. Centralized modeling involving all process variables at a time may neglect local behaviors. And most local–global modeling methods tend to ignore the correlation between units. To preserve the intra-unit information and inter-unit correlation, this paper proposes a local–global transformer (LGT) for distributed process monitoring. First, the local representation of each unit is extracted based on feedforward neural networks (FNN). Considering that the units have a fixed order in the process, the designed orthogonal positional encoding (OPE) is added to the local representation to obtain the token of each unit, which also enhances the local behaviors. Then the attention mechanism in the transformer can adaptively adjust the attention to different units and learn the inter-unit correlation from the tokens to extract global features. Finally, the distributed monitoring framework and the variable contribution rate are combined to achieve fault detection and location. The proposed LGT demonstrates the feasibility through a numerical simulation. Extensive experimental results on Tennessee Eastman (TE) process and three-phase flow (TPF) process show the superiority of LGT. The source code of LGT can be found in https://github.com/YiQian-137/Local--global-transformer . Highlights: LGT is proposed for distributed monitoring of multi-unit nonlinear processes. LGT can adaptively aggregate intra-unit information and inter-unit correlations. An OPE is designed to insert the order information of the units in the process. A distributed monitoring framework is adopted to provide accurate fault description.