A constrained minimum method for model selection. Issue 1 (18th July 2021)

• Record Type: Journal Article
• Authors: Tsao, Min
• Is Part Of: Stat. Volume 10:Issue 1(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-07-18
• Subjects: best subset selection -- consistency -- hypothesis test -- model selection -- sparse linear models; Statistics -- Periodicals; 519.2
• DOI: 10.1002/sta4.387
• Languages: English
• ISSNs: 2049-1573

Abstract

Abstract : We propose a constrained minimum method for converting a hypothesis test into a model selection criterion that pursues consistency and sparsity of the selected model explicitly. The method achieves consistency by letting the significance level of the test go to zero at a certain speed depending on the sample size. It maximizes the sparsity by choosing the most sparse model among models not rejected by the test. The method may be used for model selection whenever a hypothesis test on the model parameter vector is available. We illustrate this method through its application to the best subset selection of linear models. Numerical comparisons with existing methods show that it has excellent accuracy and its selected model converges to the true model faster than the model chosen by the Bayesian information criterion.