Variable selection through CART∗. (22nd October 2014)

• Record Type: Journal Article
• Authors: Sauve, Marie; Tuleau-Malot, Christine
• Is Part Of: ESAIM. Volume 18(2014)
• Page Start: 770
• Page End: 798
• Publication Date: 2014-10-22
• Subjects: Binary classification, -- CART, -- model selection, -- penalization, -- regression, -- variable selection; Probabilities -- Periodicals; Mathematical statistics -- Periodicals; 519.2
• DOI: 10.1051/ps/2014006
• Languages: English
• ISSNs: 1292-8100

Abstract

Abstract : This paper deals with variable selection in regression and binary classification frameworks. It proposes an automatic and exhaustive procedure which relies on the use of the CART algorithm and on model selection via penalization. This work, of theoretical nature, aims at determining adequate penalties, i.e. penalties which allow achievement of oracle type inequalities justifying the performance of the proposed procedure. Since the exhaustive procedure cannot be realized when the number of variables is too large, a more practical procedure is also proposed and still theoretically validated. A simulation study completes the theoretical results.