Dynamic transfer partial least squares for domain adaptive regression. (October 2022)

• Record Type: Journal Article
• Authors: Zhao, Zhijun; Yan, Gaowei; Ren, Mifeng; Cheng, Lan; Zhu, Zhujun; Pang, Yusong
• Is Part Of: Journal of process control. Volume 118(2022)
• Page Start: 55
• Page End: 68
• Publication Date: 2022-10
• Subjects: Transfer learning -- Dynamic partial least squares -- Domain adaptive regression; Process control -- Periodicals; Fabrication -- Contrôle -- Périodiques; Process control; Periodicals; Electronic journals; 660.281
• DOI: 10.1016/j.jprocont.2022.08.011
• Languages: English
• ISSNs: 0959-1524

Abstract

Abstract: The traditional soft sensor models are based on the independent and identical distribution assumption, which are difficult to adapt to changes in data distribution under multiple operating conditions, resulting in model performance deterioration. The domain adaptive transfer learning methods learn knowledge in different domains by means of distribution alignment, which can reduce the impact of data distribution differences, and effectively improve the generalization ability of the model. However, most of the existing models established by domain adaptation methods are static models, which cannot reflect the dynamic characteristics of the system, and have limited prediction accuracy when applied to dynamic system modeling under multiple operating conditions. The dynamic system modeling methods can effectively extract the dynamic characteristics of the data, but they cannot deal with the concept drift problem caused by the change of data distribution. This paper proposes a new dynamic transfer partial least squares method, which maps the high-dimensional process data into the low-dimensional latent variable subspace, establishes the dynamic regression relationship between the latent variables and the labels, and realizes the systematic dynamic modeling, at the same time, the model adds regular terms for distribution alignment and structure preservation, which realizes dynamic alignment of data distribution difference. The effectiveness of the proposed method is validated on three publicly available industrial process datasets. Graphical abstract: Highlights: This paper proposes a novel dynamic transfer partial least squares algorithm (DTPLS). DTPLS can solve the concept drift problem under the multiple working conditions. Distribution alignment regularization is designed based on distribution differences. Structure preservation regularization is designed based on smoothness assumptions.