Statistical Modelling 18 (3-4) (2018), 365384
Boosting for statistical modelling-A non-technical introduction
Andreas Mayr
Institut für Statistik,
Ludwig-Maxilians-Universität,
München,
Germany
e-mail: andreas.mayr@stat.uni-muenchen.de
and
Institut für Medizininformatik,
Biometrie und Epidemiologie,
Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU),
Erlangen,
Germany
Benjamin Hofner
Paul-Ehrlich-Institut,
Langen,
Germany
Abstract:
Boosting algorithms were originally developed for machine learning but were later adapted to estimate statistical models—offering various practical advantages such as automated variable selection and implicit regularization of effect estimates. The interpretation of the resulting models, however, remains the same as if they had been fitted by classical methods. Boosting, hence, allows to use an advanced machine learning scheme to estimate various types of statistical models. This tutorial aims to highlight how boosting can be used for semi-parametric modelling, what practical implications follow from the design of the algorithm and what kind of drawbacks data analysts have to expect. We illustrate the application of boosting in the analysis of a stunting score from children in India and a high-dimensional dataset of tumour DNA to develop a biomarker for the occurrence of metastases in breast cancer patients.
Keywords:
variable selection; High-dimensional data; model choice; statistical learning.
Downloads:
Example data and code in
zipped archive.
back