A Survey of L1 Regression. (24th October 2013)

• Record Type: Journal Article
• Authors: Vidaurre, Diego; Bielza, Concha; Larrañaga, Pedro
• Is Part Of: International statistical review. Volume 81:Number 3(2013:Dec.)
• Page Start: 361
• Page End: 387
• Publication Date: 2013-10-24
• Subjects: Regularization -- lasso -- L1‐regularized regression -- sparsity; Statistics -- Periodicals; Statistics -- Bibliography -- Periodicals; Statistics -- Bibliography; Statistics -- Periodicals; Statistique; Statistique -- Périodiques; Statistique -- Bibliographie -- Périodiques; Statistique -- Étude et enseignement -- Périodiques; Statistique -- Étude et enseignement -- Bibliographie -- Périodiques; Ressource Internet (Descripteur de forme); Périodique électronique (Descripteur de forme); 519.2
• DOI: 10.1111/insr.12023
• Languages: English
• ISSNs: 0306-7734

Abstract

Summary: L 1 regularization, or regularization with an L 1 penalty, is a popular idea in statistics and machine learning. This paper reviews the concept and application of L 1 regularization for regression. It is not our aim to present a comprehensive list of the utilities of the L 1 penalty in the regression setting. Rather, we focus on what we believe is the set of most representative uses of this regularization technique, which we describe in some detail. Thus, we deal with a number of L 1 ‐regularized methods for linear regression, generalized linear models, and time series analysis. Although this review targets practice rather than theory, we do give some theoretical details about L 1 ‐penalized linear regression, usually referred to as the least absolute shrinkage and selection operator (lasso).