A new accelerated proximal boosting machine with convergence rate O(1/t^2)

DOI10.1007/S12190-021-01684-WMaRDI QIDQ2103099zbMATHOpenAlexFDO

Authors Jinxiang Li, Na Zhen, Yiming Yang, Fu-Sheng Wang

Publication date 13 December 2022

Published in Journal of Applied Mathematics and Computing (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/s12190-021-01684-w

zbMATH Keywords

convergence rateboosting machinecorrected pseudo-residualmomentum sequenceproximal boosting algorithm

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Accelerated gradient boosting
• Some theory for generalized boosting algorithms
• Boosting with early stopping: convergence and consistency
• The boosting approach to machine learning: an overview
• SVM-boosting based on Markov resampling: theory and algorithm

Cites work

• A decision-theoretic generalization of on-line learning and an application to boosting
• A primal-dual convergence analysis of boosting
• Accelerated gradient boosting
• AdaBoost is consistent
• Additive logistic regression: a statistical view of boosting. (With discussion and a rejoinder by the authors)
• Arcing classifiers. (With discussion)
• Boosting With theL₂Loss
• Boosting a weak learning algorithm by majority
• Boosting with early stopping: convergence and consistency
• Greedy function approximation: A gradient boosting machine.
• Introductory lectures on convex optimization. A basic course.
• Logistic regression, AdaBoost and Bregman distances
• MLlib: machine learning in Apache Spark
• Population theory for boosting ensembles.
• Prediction Games and Arcing Algorithms
• Randomized Gradient Boosting Machine
• Scikit-learn: machine learning in Python
• Some theory for generalized boosting algorithms
• Stochastic gradient boosting.

Describes a project that uses

Uses Software

• Scikit
• TensorFlow
• MLlib
• XGBoost
• LightGBM
• Apache Spark

This page was built for publication: A new accelerated proximal boosting machine with convergence rate \(O(1/t^2)\)

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2103099)