Posterior concentration for Bayesian regression trees and forests

DOI10.1214/19-AOS1879zbMath1459.62057arXiv1708.08734MaRDI QIDQ2215727

Stéphanie van der Pas, Veronika Rockova

Publication date: 14 December 2020

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1708.08734

zbMATH Keywords

BARTrecursive partitioningregression treesadditive regressionposterior concentrationasymptotic minimaxityBayesian CART

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Classification and discrimination; cluster analysis (statistical aspects) (62H30)

Related Items (20)

Smoothing and adaptation of shifted Pólya tree ensembles ⋮ Bayesian neural tree models for nonparametric regression ⋮ Adaptive Conditional Distribution Estimation with Bayesian Decision Tree Ensembles ⋮ Unnamed Item ⋮ Unsupervised discretization by two-dimensional MDL-based histogram ⋮ Bayesian CART models for insurance claims frequency ⋮ Large Scale Prediction with Decision Trees ⋮ Bayesian additive regression trees for genotype by environment interaction models ⋮ Gibbs Priors for Bayesian Nonparametric Variable Selection with Weak Learners ⋮ mBART: multidimensional monotone BART ⋮ Concentration of posterior model probabilities and normalized \({L_0}\) criteria ⋮ Adaptive Bayesian nonparametric regression using a kernel mixture of polynomials with application to partial linear models ⋮ Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects (with discussion) ⋮ Bayesian additive regression trees with model trees ⋮ Heteroscedastic BART via Multiplicative Regression Trees ⋮ Uncertainty quantification for Bayesian CART ⋮ Rates of contraction with respect to \(L_2\)-distance for Bayesian nonparametric regression ⋮ Log-Linear Bayesian Additive Regression Trees for Multinomial Logistic and Count Regression Models ⋮ Stochastic Tree Search for Estimating Optimal Dynamic Treatment Regimes ⋮ Optional Pólya trees: posterior rates and uncertainty quantification

Uses Software

• BartPy

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• BART: Bayesian additive regression trees
• Supremum norm posterior contraction and credible sets for nonparametric multivariate regression
• Variable selection for BART: an application to gene regulation
• Almost surely consistent nonparametric regression from recursive partitioning schemes
• Consistency of Bayesian estimation of a step function
• Bayesian linear regression with sparse priors
• A Bernstein-von Mises theorem for smooth functionals in semiparametric models
• Rates of contraction of posterior distributions based on Gaussian process priors
• Convergence rates of posterior distributions for non iid observations
• Consistent nonparametric regression from recursive partitioning schemes
• Consistent nonparametric regression. Discussion
• A simple wavelet approach to nonparametric regression from recursive partitioning schemes
• CART and best-ortho-basis: a connection
• Pólya tree posterior distributions on densities
• Histogram regression estimation using data-dependent partitions
• Optimal global rates of convergence for nonparametric regression
• Convergence rates of posterior distributions.
• Rates of convergence of posterior distributions.
• Needles and straw in a haystack: posterior concentration for possibly sparse sequences
• Semiparametric Bernstein-von Mises for the error standard deviation
• Minimax-optimal nonparametric regression in high dimensions
• Anisotropic function estimation using multi-bandwidth Gaussian processes
• Consistency of Bayes estimators of a binary regression function
• Consistency of random forests
• A random forest guided tour
• On Rates of Convergence for Bayesian Density Estimation
• Multidimensional binary search trees used for associative searching
• A Bayesian CART algorithm
• Bayesian Regression Tree Ensembles that Adapt to Smoothness and Sparsity
• Bayesian Regression Trees for High-Dimensional Prediction and Variable Selection
• Multivariate Density Estimation by Bayesian Sequential Partitioning
• Random forests

This page was built for publication: Posterior concentration for Bayesian regression trees and forests