# Boosting Algorithms: Regularization, Prediction and Model Fitting

**Authors:** Peter B\"uhlmann, Torsten Hothorn

arXiv: 0804.2752 · 2008-12-18

## TL;DR

This paper offers a statistical perspective on boosting algorithms, focusing on their application to complex models, regularization, and variable selection, supported by an open-source software package for practical implementation.

## Contribution

It introduces a comprehensive statistical framework for boosting, emphasizing regularization and model selection, and provides a flexible software package for practical use.

## Key findings

- Effective regularization in high-dimensional models
- Implementation of boosting for various statistical models
- Open-source software facilitates model fitting and variable selection

## Abstract

We present a statistical perspective on boosting. Special emphasis is given to estimating potentially complex parametric or nonparametric models, including generalized linear and additive models as well as regression models for survival analysis. Concepts of degrees of freedom and corresponding Akaike or Bayesian information criteria, particularly useful for regularization and variable selection in high-dimensional covariate spaces, are discussed as well. The practical aspects of boosting procedures for fitting statistical models are illustrated by means of the dedicated open-source software package mboost. This package implements functions which can be used for model fitting, prediction and variable selection. It is flexible, allowing for the implementation of new boosting algorithms optimizing user-specified loss functions.

## Full text

Tomesphere does not host the full text of arXiv papers. Read it on arXiv: https://arxiv.org/abs/0804.2752

---
Source: https://tomesphere.com/paper/0804.2752