Accelerated gradient boosting

DOI10.1007/S10994-019-05787-1zbMath1493.68293arXiv1803.02042OpenAlexW2794238513WikidataQ128448954 ScholiaQ128448954MaRDI QIDQ2425242

Benoît Cadre, Gérard Biau, Laurent Rouvière

Publication date: 26 June 2019

Published in: Machine Learning (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1803.02042

zbMATH Keywords

treesgradient boostingNesterov's acceleration

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Related Items (3)

Fully corrective gradient boosting with squared hinge: fast learning rates and early stopping ⋮ Benchmark for filter methods for feature selection in high-dimensional classification data ⋮ A new accelerated proximal boosting machine with convergence rate \(O(1/t^2)\)

Uses Software

• NESTA
• gbm
• AdaBoost.MH
• ElemStatLearn
• COBRA
• XGBoost

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Greedy function approximation: A gradient boosting machine.
• Smooth minimization of non-smooth functions
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• COBRA: a combined regression strategy
• Gradient methods for minimizing composite functions
• First-order methods of smooth convex optimization with inexact oracle
• Boosting algorithms: regularization, prediction and model fitting
• A decision-theoretic generalization of on-line learning and an application to boosting
• Introductory lectures on convex optimization. A basic course.
• Arcing classifiers. (With discussion)
• Additive logistic regression: a statistical view of boosting. (With discussion and a rejoinder by the authors)
• Population theory for boosting ensembles.
• On the Bayes-risk consistency of regularized boosting methods.
• Boosting a weak learning algorithm by majority
• Boosting with early stopping: convergence and consistency
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• NESTA: A Fast and Accurate First-Order Method for Sparse Recovery
• Boosting With theL₂Loss
• 10.1162/1532443041424319
• Accelerated Distributed Nesterov Gradient Descent
• Optimization by Gradient Boosting
• Prediction Games and Arcing Algorithms
• Random forests
• Stochastic gradient boosting.

This page was built for publication: Accelerated gradient boosting