Adaptive Conditional Distribution Estimation with Bayesian Decision Tree Ensembles
From MaRDI portal
Abstract: We present a Bayesian nonparametric model for conditional distribution estimation using Bayesian additive regression trees (BART). The generative model we use is based on rejection sampling from a base model. Typical of BART models, our model is flexible, has a default prior specification, and is computationally convenient. To address the distinguished role of the response in the BART model we propose, we further introduce an approach to targeted smoothing which is possibly of independent interest for BART models. We study the proposed model theoretically and provide sufficient conditions for the posterior distribution to concentrate at close to the minimax optimal rate adaptively over smoothness classes in the high-dimensional regime in which many predictors are irrelevant. To fit our model we propose a data augmentation algorithm which allows for existing BART samplers to be extended with minimal effort. We illustrate the performance of our methodology on simulated data and use it to study the relationship between education and body mass index using data from the medical expenditure panel survey (MEPS).
Cites work
- A Bayesian Nonparametric Regression Model With Normalized Weights: A Study of Hippocampal Atrophy in Alzheimer’s Disease
- BART with targeted smoothing: an analysis of patient-specific stillbirth risk
- BART: Bayesian additive regression trees
- Bayesian Analysis of Binary and Polychotomous Response Data
- Bayesian curve fitting using multivariate normal mixtures
- Bayesian Density Regression
- Bayesian density regression with logistic Gaussian process and subspace projection
- Bayesian quantile regression
- Bayesian regression tree ensembles that adapt to smoothness and sparsity
- Bayesian regression trees for high-dimensional prediction and variable selection
- Bayesian spatial quantile regression
- Bayesian survival tree ensembles with submodel shrinkage
- Convergence rates of posterior distributions.
- Data augmentation for models based on rejection sampling
- Decoupling shrinkage and selection in Bayesian linear models: a posterior summary perspective
- Heteroscedastic BART via Multiplicative Regression Trees
- scientific article; zbMATH DE number 774881 (Why is no real title available?)
- Improving prediction from Dirichlet process mixtures via enrichment
- Kernel stick-breaking processes
- Laplace approximation for logistic Gaussian process density estimation and regression
- Latent factor models for density estimation
- Minimax-optimal nonparametric regression in high dimensions
- Model Interpretation Through Lower-Dimensional Posterior Summarization
- Nonlinear models using Dirichlet process mixtures
- Nonparametric Bayes conditional distribution modeling with variable selection
- Nonparametric Bayesian models through probit stick-breaking processes
- Posterior concentration for Bayesian regression trees and forests
- Posterior consistency in conditional distribution estimation
- Posterior consistency of Dirichlet mixtures in density estimation
- Posterior Inference in Bayesian Quantile Regression with Asymmetric Laplace Likelihood
- Quantile Regression under Misspecification, with an Application to the U.S. Wage Structure
- Random forests
- Rates of contraction of posterior distributions based on Gaussian process priors
- Recursively imputed survival trees
- Semiparametric analysis of clustered interval‐censored survival data using soft Bayesian additive regression trees (SBART)
Cited in
(5)- Semiparametric analysis of clustered interval‐censored survival data using soft Bayesian additive regression trees (SBART)
- Gibbs Priors for Bayesian Nonparametric Variable Selection with Weak Learners
- Treatment effect heterogeneity and importance measures for multivariate continuous treatments
- Generalized Bayesian Additive Regression Trees Models: Beyond Conditional Conjugacy
- Bayesian additive regression trees for multivariate skewed responses
This page was built for publication: Adaptive Conditional Distribution Estimation with Bayesian Decision Tree Ensembles
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6077599)
