Robust partially linear models for automatic structure discovery. (1st May 2023)

• Record Type: Journal Article
• Authors: Han, Yuxiang; Chen, Hong; Gong, Tieliang; Cai, Jia; Deng, Hao
• Is Part Of: Expert systems with applications. Volume 217(2023)
• Publication Date: 2023-05-01
• Subjects: Learning theory -- Partially linear models -- Kernel methods -- Modal regression -- Structure discovery; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2023.119528
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: Partially linear models (PLMs), rooted in the combination of linear and nonlinear approximation, are recognized to be capable of modeling complex data. Indeed, the performance of PLMs depends heavily on the choice of model structure, such as which covariates have linear or nonlinear effects on the response. Nevertheless, most existing PLMs are limited to the mean regression, resulting in sensitivity to non-Gaussian noises, such as skewed noise and heavy-tailed noise. In order to mitigate the influence of noise in structure discovery, this paper proposes a Robust Linear And Nonlinear Discovery algorithm (RLAND) by integrating the modal regression and PLMs. Statistical analysis on generalization bound and structure discovery consistency are established to characterize its learning theory foundations. Computation analysis illustrates that the RLAND can be efficiently realized by half quadratic optimization and the quadratic programming. Empirical evaluations on simulation and real-world data validate the competitive performance of the proposed method. Highlights: A class of robust partial linear model, called RLAND, is proposed for structure discovery. RLAND is based on modal regression. RLAND can effectively identify the linear and nonlinear components of covariates under complex data noise.