Uncertainty quantification for Bayesian CART
From MaRDI portal
Publication:2073718
Abstract: This work affords new insights into Bayesian CART in the context of structured wavelet shrinkage. The main thrust is to develop a formal inferential framework for Bayesian tree-based regression. We reframe Bayesian CART as a g-type prior which departs from the typical wavelet product priors by harnessing correlation induced by the tree topology. The practically used Bayesian CART priors are shown to attain adaptive near rate-minimax posterior concentration in the supremum norm in regression models. For the fundamental goal of uncertainty quantification, we construct adaptive confidence bands for the regression function with uniform coverage under self-similarity. In addition, we show that tree-posteriors enable optimal inference in the form of efficient confidence sets for smooth functionals of the regression function.
Recommendations
Cites work
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 4070082 (Why is no real title available?)
- A Bayesian CART algorithm
- A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
- A new class of unbalanced Haar wavelets that form an unconditional basis for \(L_ p\) on general measure spaces
- A simple wavelet approach to nonparametric regression from recursive partitioning schemes
- Adaptive Bayesian Wavelet Shrinkage
- Adaptive Bayesian density estimation in \(L^p\)-metrics with Pitman-Yor or normalized inverse-Gaussian process kernel mixtures
- Adaptive Bernstein-von Mises theorems in Gaussian white noise
- Analysis of a random forests model
- Asymptotic equivalence of nonparametric regression and white noise
- BART: Bayesian additive regression trees
- Bayesian optimal adaptive estimation using a sieve prior
- Bayesian regression tree ensembles that adapt to smoothness and sparsity
- Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects (with discussion)
- Bayesian regression trees for high-dimensional prediction and variable selection
- Benchmark priors for Bayesian model averaging.
- Bernstein-von Mises theorems for statistical inverse problems. II: Compound Poisson processes
- CART and best-ortho-basis: a connection
- Consistency of random forests
- Convergence rates of posterior distributions.
- Criteria for Bayesian model choice with application to variable selection
- Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
- Frequentist coverage of adaptive nonparametric Bayesian credible sets
- Fundamentals of nonparametric Bayesian inference
- Honest adaptive confidence bands and self-similar functions
- Learning Theory
- Lower bounds for posterior rates with Gaussian process priors
- Mathematical foundations of infinite-dimensional statistical models
- Minimax-optimal classification with dyadic decision trees
- Model Selection for CART Regression Trees
- Model-Based Compressive Sensing
- Multiscale Poisson Intensity and Density Estimation
- Nonparametric Bernstein-von Mises theorems in Gaussian white noise
- Nonparametric statistical inference for drift vector fields of multi-dimensional diffusions
- On Bayesian supremum norm contraction rates
- On adaptive posterior concentration rates
- On information pooling, adaptability and superefficiency in nonparametric function estimation
- On the Bernstein-von Mises phenomenon for nonparametric Bayes procedures
- Optimal predictive model selection.
- Optional Pólya tree and Bayesian inference
- Posterior concentration for Bayesian regression trees and forests
- Pólya tree posterior distributions on densities
- Quantifying uncertainty in random forests via confidence intervals and hypothesis tests
- Rates of contraction for posterior distributions in \(L^{r}\)-metrics, \(1 \leq r \leq \infty\)
- Spike and slab Pólya tree posterior densities: adaptive inference
- Supremum norm posterior contraction and credible sets for nonparametric multivariate regression
- The risk inflation criterion for multiple regression
- Unbalanced Haar Technique for Nonparametric Function Estimation
- Variable selection for BART: an application to gene regulation
- Wavelets on the interval and fast wavelet transforms
Cited in
(5)- Smoothing and adaptation of shifted Pólya tree ensembles
- Posterior concentration for Bayesian regression trees and forests
- Heavy-tailed Bayesian nonparametric adaptation
- Optional Pólya trees: posterior rates and uncertainty quantification
- Multidimensional adaptive relevance vector machines for uncertainty quantification
This page was built for publication: Uncertainty quantification for Bayesian CART
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2073718)