Variable selection via additive conditional independence. (29th January 2016)

• Record Type: Journal Article
• Authors: Lee, Kuang‐Yao; Li, Bing; Zhao, Hongyu
• Is Part Of: Journal of the Royal Statistical Society. Volume 78:Number 5(2016:Nov.)
• Page Start: 1037
• Page End: 1055
• Publication Date: 2016-01-29
• Subjects: Additive covariance operator -- Heterogeneity -- Lasso -- Regression operator -- Reproducing kernel Hilbert space -- Sparsity -- Variable selection consistency; Statistics -- Periodicals; Great Britain -- Statistics -- Periodicals; 519.2
• DOI: 10.1111/rssb.12150
• Languages: English
• ISSNs: 1369-7412

Abstract

Summary: We propose a non‐parametric variable selection method which does not rely on any regression model or predictor distribution. The method is based on a new statistical relationship, called additive conditional independence, that has been introduced recently for graphical models. Unlike most existing variable selection methods, which target the mean of the response, the method proposed targets a set of attributes of the response, such as its mean, variance or entire distribution. In addition, the additive nature of this approach offers non‐parametric flexibility without employing multi‐dimensional kernels. As a result it retains high accuracy for high dimensional predictors. We establish estimation consistency, convergence rate and variable selection consistency of the method proposed. Through simulation comparisons we demonstrate that the method proposed performs better than existing methods when the predictor affects several attributes of the response, and it performs competently in the classical setting where the predictors affect the mean only. We apply the new method to a data set concerning how gene expression levels affect the weight of mice.