Gaussian process modelling with Gaussian mixture likelihood. (September 2019)

• Record Type: Journal Article
• Authors: Daemi, Atefeh; Kodamana, Hariprasad; Huang, Biao
• Is Part Of: Journal of process control. Volume 81(2019)
• Page Start: 209
• Page End: 220
• Publication Date: 2019-09
• Subjects: Gaussian process -- EM algorithm -- Gaussian mixture model -- Outliers; Process control -- Periodicals; Fabrication -- Contrôle -- Périodiques; Process control; Periodicals; Electronic journals; 660.281
• DOI: 10.1016/j.jprocont.2019.06.007
• Languages: English
• ISSNs: 0959-1524

Abstract

Highlights: Extend Gaussian process modelling from single Gaussian noise to mixture Gaussian noises. Develop robust Gaussian process modelling to handle outliers in process data analysis. The problem is solved under maximum likelihood framework through expectation maximization algorithm. Abstract: Gaussian Process (GP), as a probabilistic non-linear multi-variable regression model, has been widely used in nonparametric Bayesian framework for the data based modelling of complex processes. The noise dynamics in standard GP regression is assumed to follow a Gaussian distribution. In this setting, the point estimation of the model parameters can be obtained analytically using the maximum likelihood (ML) approach in a straight forward fashion. However, in practical scenarios, processes may have been corrupted by the outliers and other disturbances or have multiple modes of operation, resulting a non-Gaussian data likelihood. In this work, to model such scenarios, we propose to employ a mixture of two Gaussian distributions as the noise model to capture both regular noise and irregular noise, thereby enhancing the robustness of the regression model. Further, we present an Expectation Maximization (EM) algorithm-based approach to obtain the optimal parameters set of the proposed GP regression model. The predictive distribution can then be found according to the estimated hyperparameters from the EM algorithm. The efficacy and practicality of the proposed method are illustrated with two sets of synthetic data, a simulated example, as well as an industrial dataset.