Additive logistic regression: a statistical view of boosting. (With discussion and a rejoinder by the authors)

DOI10.1214/AOS/1016218223zbMath1106.62323OpenAlexW2024046085WikidataQ93494458 ScholiaQ93494458MaRDI QIDQ1848780

Robert Tibshirani, Trevor Hastie, Jerome H. Friedman

Publication date: 14 November 2002

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://projecteuclid.org/euclid.aos/1016218223

zbMATH Keywords

classification tree machine learning nonparametric estimation stagewise fitting

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05)

Related Items (only showing first 100 items - show all)

Two-step sparse boosting for high-dimensional longitudinal data with varying coefficients ⋮ Learning ELM-tree from big data based on uncertainty reduction ⋮ Robust variable selection with exponential squared loss for the spatial autoregressive model ⋮ Cost-sensitive ensemble learning: a unifying framework ⋮ On the accuracy of cross-validation in the classification problem ⋮ Representation in the (artificial) immune system ⋮ Finding causative genes from high-dimensional data: an appraisal of statistical and machine learning approaches ⋮ Some relationships between fuzzy and random set-based classifiers and models ⋮ An empirical comparison of classification algorithms for mortgage default prediction: evidence from a distressed mortgage market ⋮ Logistic regression using covariates obtained by product-unit neural network models ⋮ Cost-sensitive boosting algorithms: do we really need them? ⋮ Tutorial series on brain-inspired computing. VI: Geometrical structure of boosting algorithm ⋮ Mean and quantile boosting for partially linear additive models ⋮ Improved nearest neighbor classifiers by weighting and selection of predictors ⋮ Logitboost autoregressive networks ⋮ Gradient boosting for high-dimensional prediction of rare events ⋮ Improved customer choice predictions using ensemble methods ⋮ \(L_{2}\) boosting in kernel regression ⋮ Self-improved gaps almost everywhere for the agnostic approximation of monomials ⋮ A Fisher consistent multiclass loss function with variable margin on positive examples ⋮ Small area estimation of the homeless in Los Angeles: an application of cost-sensitive stochastic gradient boosting ⋮ On hybrid classification using model assisted posterior estimates ⋮ Blasso for object categorization and retrieval: towards interpretable visual models ⋮ Complexity in the case against accuracy estimation ⋮ A simple extension of boosting for asymmetric mislabeled data ⋮ Further results on the margin explanation of boosting: new algorithm and experiments ⋮ Survival ensembles by the sum of pairwise differences with application to lung cancer microarray studies ⋮ Kullback-Leibler aggregation and misspecified generalized linear models ⋮ Boosting algorithms: regularization, prediction and model fitting ⋮ Comment on: Boosting algorithms: regularization, prediction and model fitting ⋮ Rejoinder: Boosting algorithms: regularization, prediction and model fitting ⋮ A boosting method for maximization of the area under the ROC curve ⋮ Representing and recognizing objects with massive local image patches ⋮ A boosting approach for supervised Mahalanobis distance metric learning ⋮ Functional gradient ascent for probit regression ⋮ A noise-detection based AdaBoost algorithm for mislabeled data ⋮ Fully corrective boosting with arbitrary loss and regularization ⋮ Vote counting measures for ensemble classifiers. ⋮ On a method for constructing ensembles of regression models ⋮ Entropy and divergence associated with power function and the statistical application ⋮ Sparse regression and support recovery with \(\mathbb{L}_2\)-boosting algorithms ⋮ Boosting multi-features with prior knowledge for mini unmanned helicopter landmark detection ⋮ A fast genetic method for inducting descriptive fuzzy models. ⋮ Statistical modeling: The two cultures. (With comments and a rejoinder). ⋮ A concrete statistical realization of Kleinberg's stochastic dicrimination for pattern recognition. I: Two-class classification ⋮ Does modeling lead to more accurate classification? A study of relative efficiency in linear classification ⋮ A sharp nonasymptotic bound and phase diagram of \(L_{1/2}\) regularization ⋮ Unsupervised weight parameter estimation method for ensemble learning ⋮ Cox process functional learning ⋮ Boosting conditional probability estimators ⋮ Counting and enumerating aggregate classifiers ⋮ Soft memberships for spectral clustering, with application to permeable language distinction ⋮ An extensive comparison of recent classification tools applied to microarray data ⋮ Boosting and instability for regression trees ⋮ Boosting additive models using component-wise P-splines ⋮ Using boosting to prune double-bagging ensembles ⋮ Additive prediction and boosting for functional data ⋮ Boosting nonlinear additive autoregressive time series ⋮ Taxonomy for characterizing ensemble methods in classification tasks: a review and annotated bibliography ⋮ Greedy function approximation: A gradient boosting machine. ⋮ Non-crossing large-margin probability estimation and its application to robust SVM via pre\-condi\-tion\-ing ⋮ A cascade of boosted generative and discriminative classifiers for vehicle detection ⋮ Model-based boosting in R: a hands-on tutorial using the R package mboost ⋮ Remembering Leo Breiman ⋮ Remembrance of Leo Breiman ⋮ Node harvest ⋮ Quadratic Majorization for Nonconvex Loss with Applications to the Boosting Algorithm ⋮ Robust boosting with truncated loss functions ⋮ Navigating random forests and related advances in algorithmic modeling ⋮ Boosting GARCH and neural networks for the prediction of heteroskedastic time series ⋮ Nearly unbiased variable selection under minimax concave penalty ⋮ Cost-sensitive boosting for classification of imbalanced data ⋮ Functional dissipation microarrays for classification ⋮ Estimating the dimension of a model ⋮ New multicategory boosting algorithms based on multicategory Fisher-consistent losses ⋮ Tree-structured modelling of categorical predictors in generalized additive regression ⋮ A new hybrid classification algorithm for customer churn prediction based on logistic regression and decision trees ⋮ Boosting in Cox regression: a comparison between the likelihood-based and the model-based approaches with focus on the R-packages \textit{CoxBoost} and \textit{mboost} ⋮ Optimal prediction pools ⋮ Robust exponential squared loss-based variable selection for high-dimensional single-index varying-coefficient model ⋮ Obtaining linguistic fuzzy rule-based regression models from imprecise data with multiobjective genetic algorithms ⋮ Ensemble classification based on generalized additive models ⋮ Sketching information divergences ⋮ Boosted Bayesian network classifiers ⋮ Exact bootstrap \(k\)-nearest neighbor learners ⋮ Surrogate maximization/minimization algorithms and extensions ⋮ A dynamic model of expected bond returns: A functional gradient descent approach ⋮ A weight-adjusted voting algorithm for ensembles of classifiers ⋮ Iterative bias reduction: a comparative study ⋮ Soft-max boosting ⋮ Parallelizing AdaBoost by weights dynamics ⋮ Boosting ridge regression ⋮ A stochastic approximation view of boosting ⋮ A local boosting algorithm for solving classification problems ⋮ Logitboost with errors-in-variables ⋮ A \(\mathbb R\)eal generalization of discrete AdaBoost ⋮ On boosting kernel regression ⋮ Embedding ensemble tracking in a stochastic framework for robust object tracking ⋮ A geometric approach to leveraging weak learners ⋮ A conversation with Jerry Friedman

Uses Software

AdaBoost.MH

Cites Work

This page was built for publication: Additive logistic regression: a statistical view of boosting. (With discussion and a rejoinder by the authors)