Posterior concentration for Bayesian regression trees and forests
The authors consider the already classical nonparametric regression model \(Y_i=f_0(\mathbf{x} _i)+\epsilon_i\), where \(\mathbf{x}_i=(x_{i1},\dots, x_{ip})'\), \(1\leq i\leq n\), are \(p\) potential covariates, \(Y_i\) are the responses and \(\epsilon _i\) are the noise variables. The statistical problem is to recover \(f_0\) from the samples (\(\mathbf{x}_i\), \(Y_i\)). In the present paper, from the class of nonparametric prediction methods, Bayesian regression trees and forests are considered and studied. As stated by the authors, the goal of this paper is to provide optimality results for Bayesian regression trees. They introduce a new variant of the Bayesian CART prior for dimension reduction and model-free variable selection, the spike-and-tree prior. A set of theoretical results is provided. Some basics are presented in the second section and the definitions of recursive partitions in the third one. Notions as valid partitions, balanced partitions, tree partitions, \(k\)-d tree partitions, tree-structured step functions are explained. In the fourth section one introduces the concept of spike-and-tree priors and one shows that the posterior distribution under the Bayesian CART prior has optimal properties. A detailed analysis of the collective behavior of partitioning cells generated by individual trees is done in the fifth section. A result regarding the posterior concentration for Bayesian additive regression trees in case \(f_0\) has an additive structure is presented in the sixth section. There follow some implementation considerations as well as a short discussion on the results. The eighth section and a supplementary material entitled: Supplement to ``Posterior concentration for Bayesian regression trees and forests, \url{doi:10.1214/19-AOS1879SUPP} contain detailed proofs of the results.
- A Bayesian CART algorithm
- A Bernstein-von Mises theorem for smooth functionals in semiparametric models
- A random forest guided tour
- A simple wavelet approach to nonparametric regression from recursive partitioning schemes
- Almost surely consistent nonparametric regression from recursive partitioning schemes
- Analysis of a random forests model
- Anisotropic function estimation using multi-bandwidth Gaussian processes
- BART: Bayesian additive regression trees
- Bayesian linear regression with sparse priors
- Bayesian regression tree ensembles that adapt to smoothness and sparsity
- Bayesian regression trees for high-dimensional prediction and variable selection
- CART and best-ortho-basis: a connection
- Consistency of Bayes estimators of a binary regression function
- Consistency of Bayesian estimation of a step function
- Consistency of random forests
- Consistency of random forests and other averaging classifiers
- Consistent nonparametric regression from recursive partitioning schemes
- Consistent nonparametric regression. Discussion
- Convergence rates of posterior distributions for non iid observations
- Convergence rates of posterior distributions.
- Histogram regression estimation using data-dependent partitions
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 3982282 (Why is no real title available?)
- scientific article; zbMATH DE number 893887 (Why is no real title available?)
- scientific article; zbMATH DE number 6791298 (Why is no real title available?)
- scientific article; zbMATH DE number 3388434 (Why is no real title available?)
- Minimax-optimal nonparametric regression in high dimensions
- Multidimensional binary search trees used for associative searching
- Multivariate density estimation by Bayesian sequential partitioning
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- On Rates of Convergence for Bayesian Density Estimation
- Optimal global rates of convergence for nonparametric regression
- Pólya tree posterior distributions on densities
- Random forests
- Rates of contraction of posterior distributions based on Gaussian process priors
- Rates of convergence of posterior distributions.
- Semiparametric Bernstein-von Mises for the error standard deviation
- Supremum norm posterior contraction and credible sets for nonparametric multivariate regression
- Variable selection for BART: an application to gene regulation
- Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects (with discussion)
- Bayesian additive regression trees with model trees
- Uncertainty quantification for Bayesian CART
- Optional Pólya trees: posterior rates and uncertainty quantification
- Adaptive Bayesian nonparametric regression using a kernel mixture of polynomials with application to partial linear models
- Rates of contraction with respect to \(L_2\)-distance for Bayesian nonparametric regression
- Smoothing and adaptation of shifted Pólya tree ensembles
- Heteroscedastic BART via Multiplicative Regression Trees
- Bayesian regression tree ensembles that adapt to smoothness and sparsity
- Bayesian regression trees for high-dimensional prediction and variable selection
- scientific article; zbMATH DE number 7370554 (Why is no real title available?)
- Log-linear Bayesian additive regression trees for multinomial logistic and count regression models
- Shrinkage Bayesian Causal Forests for Heterogeneous Treatment Effects Estimation
- Efficient Metropolis-Hastings proposal mechanisms for Bayesian regression tree models
- Marginal likelihood and model selection for Gaussian latent tree and forest models
- Stochastic tree search for estimating optimal dynamic treatment regimes
- Bayesian neural tree models for nonparametric regression
- Adaptive Conditional Distribution Estimation with Bayesian Decision Tree Ensembles
- Stochastic Tree Ensembles for Regularized Nonlinear Regression
- Unsupervised discretization by two-dimensional MDL-based histogram
- Bayesian CART models for insurance claims frequency
- Large Scale Prediction with Decision Trees
- Bayesian additive regression trees for genotype by environment interaction models
- Gibbs Priors for Bayesian Nonparametric Variable Selection with Weak Learners
- mBART: multidimensional monotone BART
- Concentration of posterior model probabilities and normalized \({L_0}\) criteria
- Variable selection using Bayesian additive regression trees
- Improved inference for doubly robust estimators of heterogeneous treatment effects
- The how and why of Bayesian nonparametric causal inference
- Incorporating external data into the analysis of clinical trials via Bayesian additive regression trees
- Ideal Bayesian Spatial Adaptation
- Seemingly unrelated Bayesian additive regression trees for cost-effectiveness analyses in healthcare
- L₂-norm posterior contraction in Gaussian models with unknown variance
- Bayesian cart models for aggregate claim modeling
- Tree-based additive noise directed acyclic graphical models for nonlinear causal discovery with interactions
- Accounting for shared covariates in semiparametric Bayesian additive regression trees
- A tree-based Bayesian accelerated failure time cure model for estimating heterogeneous treatment effect
- Generalized Bayesian Additive Regression Trees Models: Beyond Conditional Conjugacy
- Bayesian additive regression trees for multivariate skewed responses
- Nonparametric density estimation on complex domains using manifold-aware Bayesian additive tree models
- Variational Bayes neural networks for high-dimensional non parametric regression: Minimax optimality and adaptivity
- Orthogonal Calibration via Posterior Projections with Applications to the Schwarzschild Model
- VCBART: Bayesian trees for varying coefficients
This page was built for publication: Posterior concentration for Bayesian regression trees and forests
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2215727)
