Adversarial smoothing tri-regression for robust semi-supervised industrial soft sensor. (December 2021)

• Record Type: Journal Article
• Authors: Feng, Liangjun; Zhao, Chunhui; Huang, Biao
• Is Part Of: Journal of process control. Volume 108(2021)
• Page Start: 86
• Page End: 97
• Publication Date: 2021-12
• Subjects: Smoothing regularization -- Robust modeling -- Semi-supervised learning -- Tri-training strategy -- Soft sensor -- Industrial application; Process control -- Periodicals; Fabrication -- Contrôle -- Périodiques; Process control; Periodicals; Electronic journals; 660.281
• DOI: 10.1016/j.jprocont.2021.11.001
• Languages: English
• ISSNs: 0959-1524

Abstract

Abstract: In industrial processes, soft sensor techniques are used to predict the hard-to-measure quality variables under the classic supervised learning paradigm. However, the data challenges, i . e ., the widespread noises and inadequate labeled samples, usually make the data-driven sensors weak for application. In this paper, a simple but effective regularization method termed as adversarial smoothing regularization (ASR) is proposed, which measures the local smoothness of prediction around each input sample. By minimizing the divergence between the predictions for noisy and clean inputs, the proposed ASR regulates the learning model to be robust against local perturbation in a semi-supervised manner. Theoretical analysis explains the smoothing capability of ASR, and shows that it is helpful for the improvement of generalization performance. We also design a tri-regression framework to further use the information of unlabeled samples with pseudo labels and present the adversarial smoothing tri-regression (ASTR) model for soft sensor. Based on two industrial processes, comprehensive soft sensor experiments and noise tests are performed to show the robust semi-supervised learning capability of the proposed ASR and ASTR. Highlights: A new adversarial regularization is designed to measure the local smoothness around sample for robust modeling. An adversarial tri-regression model is developed for soft sensor, which performs a semisupervised modeling. The proposed technique could reduce the prediction variance and balance the prediction bias. Experimental results on both simulated process and realistic process are provided.