Facilitating high‐dimensional transparent classification via empirical Bayes variable selection. (4th September 2018)

• Record Type: Journal Article
• Authors: Bar, Haim; Booth, James; Wells, Martin T.; Liu, Kangyan
• Is Part Of: Applied stochastic models in business and industry. Volume 34:Number 6(2018)
• Page Start: 949
• Page End: 961
• Publication Date: 2018-09-04
• Subjects: EM algorithm -- generalized linear models -- random forest -- support vector machines -- variable selection; Stochastic analysis -- Periodicals; Stochastic processes -- Periodicals; Business mathematics -- Periodicals; Finance -- Mathematical models -- Periodicals; Industrial management -- Mathematical models -- Periodicals; 338.00151923
• DOI: 10.1002/asmb.2393
• Languages: English
• ISSNs: 1524-1904

Abstract

Abstract: We present a two‐step approach to classification problems in the "large P, small N " setting, where the number of predictors may be larger than the sample size. We assume that the association between the predictors and the class variable has an approximate linear‐logistic form, but we allow the class boundaries to be nonlinear. We further assume that the number of true predictors is relatively small. In the first step, we use a binomial generalized linear model to identify which predictors are associated with each class and then restrict the data set to these predictors and run a nonlinear classifier, such as a random forest or a support vector machine. We show that, without the variable screening step, the classification performance of both the random forest and support vector machine is degraded when many among the P predictors are not related to the class.