ada: An R Package for Stochastic Boosting

Boosting is an iterative algorithm that combines simple classification rules with "mediocre" performance in terms of misclassification error rate to produce a highly accurate classification rule. Stochastic gradient boosting provides an enhancement which incorporates a random mechanism at...

Full description

Bibliographic Details
Main Authors: Mark Culp, Kjell Johnson, George Michailides
Format: Article
Language:English
Published: Foundation for Open Access Statistics 2006-09-01
Series:Journal of Statistical Software
Online Access:http://www.jstatsoft.org/index.php/jss/article/view/1510
id doaj-905f71408c8e4e70b715940c809484da
record_format Article
spelling doaj-905f71408c8e4e70b715940c809484da2020-11-24T22:20:22ZengFoundation for Open Access StatisticsJournal of Statistical Software1548-76602006-09-0117112710.18637/jss.v017.i02114ada: An R Package for Stochastic BoostingMark CulpKjell JohnsonGeorge MichailidesBoosting is an iterative algorithm that combines simple classification rules with "mediocre" performance in terms of misclassification error rate to produce a highly accurate classification rule. Stochastic gradient boosting provides an enhancement which incorporates a random mechanism at each boosting step showing an improvement in performance and speed in generating the ensemble. ada is an R package that implements three popular variants of boosting, together with a version of stochastic gradient boosting. In addition, useful plots for data analytic purposes are provided along with an extension to the multi-class case. The algorithms are illustrated with synthetic and real data sets.http://www.jstatsoft.org/index.php/jss/article/view/1510
collection DOAJ
language English
format Article
sources DOAJ
author Mark Culp
Kjell Johnson
George Michailides
spellingShingle Mark Culp
Kjell Johnson
George Michailides
ada: An R Package for Stochastic Boosting
Journal of Statistical Software
author_facet Mark Culp
Kjell Johnson
George Michailides
author_sort Mark Culp
title ada: An R Package for Stochastic Boosting
title_short ada: An R Package for Stochastic Boosting
title_full ada: An R Package for Stochastic Boosting
title_fullStr ada: An R Package for Stochastic Boosting
title_full_unstemmed ada: An R Package for Stochastic Boosting
title_sort ada: an r package for stochastic boosting
publisher Foundation for Open Access Statistics
series Journal of Statistical Software
issn 1548-7660
publishDate 2006-09-01
description Boosting is an iterative algorithm that combines simple classification rules with "mediocre" performance in terms of misclassification error rate to produce a highly accurate classification rule. Stochastic gradient boosting provides an enhancement which incorporates a random mechanism at each boosting step showing an improvement in performance and speed in generating the ensemble. ada is an R package that implements three popular variants of boosting, together with a version of stochastic gradient boosting. In addition, useful plots for data analytic purposes are provided along with an extension to the multi-class case. The algorithms are illustrated with synthetic and real data sets.
url http://www.jstatsoft.org/index.php/jss/article/view/1510
work_keys_str_mv AT markculp adaanrpackageforstochasticboosting
AT kjelljohnson adaanrpackageforstochasticboosting
AT georgemichailides adaanrpackageforstochasticboosting
_version_ 1725775490538536960