Boosting for statistical modelling-A non-technical introduction. (June 2018)

• Record Type: Journal Article
• Authors: Mayr, Andreas; Hofner, Benjamin
• Other Names: Groll Andreas guest-editor.; Kneib Thomas guest-editor.; Mayr Andreas guest-editor.
• Is Part Of: Statistical modelling. Volume 18:Number 3/4(2018)
• Page Start: 365
• Page End: 384
• Publication Date: 2018-06
• Subjects: variable selection -- High-dimensional data -- model choice -- statistical learning; Linear models (Statistics) -- Periodicals; Mathematical models -- Periodicals; Modèles linéaires (Statistique) -- Périodiques; Modèles mathématiques -- Périodiques; Modèle statistique; Modèle linéaire; Modélisation statistique; Périodique électronique (Descripteur de forme); Ressource Internet (Descripteur de forme); 519.5011
• DOI: 10.1177/1471082X17748086
• Languages: English
• ISSNs: 1471-082X

Abstract

Boosting algorithms were originally developed for machine learning but were later adapted to estimate statistical models—offering various practical advantages such as automated variable selection and implicit regularization of effect estimates. The interpretation of the resulting models, however, remains the same as if they had been fitted by classical methods. Boosting, hence, allows to use an advanced machine learning scheme to estimate various types of statistical models. This tutorial aims to highlight how boosting can be used for semi-parametric modelling, what practical implications follow from the design of the algorithm and what kind of drawbacks data analysts have to expect. We illustrate the application of boosting in the analysis of a stunting score from children in India and a high-dimensional dataset of tumour DNA to develop a biomarker for the occurrence of metastases in breast cancer patients.