Uncertainty quantification for Bayesian CART
From MaRDI portal
Abstract: This work affords new insights into Bayesian CART in the context of structured wavelet shrinkage. The main thrust is to develop a formal inferential framework for Bayesian tree-based regression. We reframe Bayesian CART as a g-type prior which departs from the typical wavelet product priors by harnessing correlation induced by the tree topology. The practically used Bayesian CART priors are shown to attain adaptive near rate-minimax posterior concentration in the supremum norm in regression models. For the fundamental goal of uncertainty quantification, we construct adaptive confidence bands for the regression function with uniform coverage under self-similarity. In addition, we show that tree-posteriors enable optimal inference in the form of efficient confidence sets for smooth functionals of the regression function.
Recommendations
Cites work
- A Bayesian CART algorithm
- A new class of unbalanced Haar wavelets that form an unconditional basis for \(L_ p\) on general measure spaces
- A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
- A simple wavelet approach to nonparametric regression from recursive partitioning schemes
- Adaptive Bayesian density estimation in \(L^p\)-metrics with Pitman-Yor or normalized inverse-Gaussian process kernel mixtures
- Adaptive Bayesian Wavelet Shrinkage
- Adaptive Bernstein-von Mises theorems in Gaussian white noise
- Analysis of a random forests model
- Asymptotic equivalence of nonparametric regression and white noise
- BART: Bayesian additive regression trees
- Bayesian optimal adaptive estimation using a sieve prior
- Bayesian regression tree ensembles that adapt to smoothness and sparsity
- Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects (with discussion)
- Bayesian regression trees for high-dimensional prediction and variable selection
- Benchmark priors for Bayesian model averaging.
- Bernstein-von Mises theorems for statistical inverse problems. II: Compound Poisson processes
- CART and best-ortho-basis: a connection
- Consistency of random forests
- Convergence rates of posterior distributions.
- Criteria for Bayesian model choice with application to variable selection
- Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
- Frequentist coverage of adaptive nonparametric Bayesian credible sets
- Fundamentals of nonparametric Bayesian inference
- Honest adaptive confidence bands and self-similar functions
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 4070082 (Why is no real title available?)
- Learning Theory
- Lower bounds for posterior rates with Gaussian process priors
- Mathematical foundations of infinite-dimensional statistical models
- Minimax-optimal classification with dyadic decision trees
- Model Selection for CART Regression Trees
- Model-Based Compressive Sensing
- Multiscale Poisson Intensity and Density Estimation
- Nonparametric Bernstein-von Mises theorems in Gaussian white noise
- Nonparametric statistical inference for drift vector fields of multi-dimensional diffusions
- On adaptive posterior concentration rates
- On Bayesian supremum norm contraction rates
- On information pooling, adaptability and superefficiency in nonparametric function estimation
- On the Bernstein-von Mises phenomenon for nonparametric Bayes procedures
- Optimal predictive model selection.
- Optional Pólya tree and Bayesian inference
- Posterior concentration for Bayesian regression trees and forests
- Pólya tree posterior distributions on densities
- Quantifying uncertainty in random forests via confidence intervals and hypothesis tests
- Rates of contraction for posterior distributions in \(L^{r}\)-metrics, \(1 \leq r \leq \infty\)
- Spike and slab Pólya tree posterior densities: adaptive inference
- Supremum norm posterior contraction and credible sets for nonparametric multivariate regression
- The risk inflation criterion for multiple regression
- Unbalanced Haar Technique for Nonparametric Function Estimation
- Variable selection for BART: an application to gene regulation
- Wavelets on the interval and fast wavelet transforms
Cited in
(8)- Optional Pólya trees: posterior rates and uncertainty quantification
- Posterior concentration for Bayesian regression trees and forests
- Smoothing and adaptation of shifted Pólya tree ensembles
- Multidimensional adaptive relevance vector machines for uncertainty quantification
- Heavy-tailed Bayesian nonparametric adaptation
- Dimension-free relaxation times of informed MCMC samplers on discrete spaces
- Exact sampling of spanning trees via fast-forwarded random walks
- On mixing rates for Bayesian CART
This page was built for publication: Uncertainty quantification for Bayesian CART
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2073718)
