Mixture of grouped regressors and its application to visual mapping. (May 2016)

• Record Type: Journal Article
• Authors: Pan, Lili; Saragih, Jason M.; Chu, Wen-Sheng
• Is Part Of: Pattern recognition. Volume 53(2016:May)
• Page Start: 184
• Page End: 194
• Publication Date: 2016-05
• Subjects: Mixture of regressors -- Group partition -- EM algorithm; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2015.10.016
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: Mixture of regressors (MoR) is a widely used regression approach for approximating nonlinear mappings between input and target outputs. However, existing learning procedures for MoR are prone to overfitting when only limited amounts of training data are available. To address this problem, we propose a new mixture regression model, named mixture of grouped regressors (MoGR). It partitions the individual regressors in the model into a set of groups, where the parameters of the regressors within each group are encouraged to take on similar values. As the parameters for each local regressor are learned using all data within a group, they tend to be better conditioned and more robust to noise in the training data. Extensive experiments on real-world head pose and gaze data demonstrate the benefits of our proposed MoGR model. Abstract : Highlights: Mixture of grouped regressors (MoGR) is proposed to tackle overfitting problems of existing Mixture of Regressors methods. MoGR partitions the individual regressors in mixture regression model into a number of groups. The parameters of each regressor are learned using all data within a group, rather than a cluster. MoGR requires a small number of training data and is robust to noise. It has shown obviously improved performance when compared with state-of-the-art nonlinear visual mapping methods.