Efficient Metropolis-Hastings proposal mechanisms for Bayesian regression tree models
From MaRDI portal
(Redirected from Publication:516518)
Abstract: Bayesian regression trees are flexible non-parametric models that are well suited to many modern statistical regression problems. Many such tree models have been proposed, from the simple single- tree model to more complex tree ensembles. Their non-parametric formulation allows for effective and efficient modeling of datasets exhibiting complex non-linear relationships between the model pre- dictors and observations. However, the mixing behavior of the Markov Chain Monte Carlo (MCMC) sampler is sometimes poor. This is because the proposals in the sampler are typically local alterations of the tree structure, such as the birth/death of leaf nodes, which does not allow for efficient traversal of the model space. This poor mixing can lead to inferential problems, such as under-representing uncertainty. In this paper, we develop novel proposal mechanisms for efficient sampling. The first is a rule perturbation proposal while the second we call tree rotation. The perturbation proposal can be seen as an efficient variation of the change proposal found in existing literature. The novel tree rotation proposal is simple to implement as it only requires local changes to the regression tree structure, yet it efficiently traverses disparate regions of the model space along contours of equal probability. When combined with the classical birth/death proposal, the resulting MCMC sampler exhibits good acceptance rates and properly represents model uncertainty in the posterior samples. We implement this sampling algorithm in the Bayesian Additive Regression Tree (BART) model and demonstrate its effectiveness on a prediction problem from computer experiments and a test function where structural tree variability is needed to fully explore the posterior.
Recommendations
Cited in
(22)- Bayesian additive regression trees using Bayesian model averaging
- Smoothing and adaptation of shifted Pólya tree ensembles
- Heteroscedastic BART via Multiplicative Regression Trees
- Tree models of Bayesian regression: a case study
- Bayesian regression trees for high-dimensional prediction and variable selection
- Log-linear Bayesian additive regression trees for multinomial logistic and count regression models
- Continuous-time birth-death MCMC for Bayesian regression tree models
- Stochastic tree search for estimating optimal dynamic treatment regimes
- The taxicab sampler: MCMC for discrete spaces with application to tree models
- Bayesian CART models for insurance claims frequency
- BART-based inference for Poisson processes
- Influential Observations in Bayesian Regression Tree Models
- Nonparametric failure time: time-to-event machine learning with heteroskedastic Bayesian additive regression trees and low information omnibus Dirichlet process mixtures
- Model Mixing Using Bayesian Additive Regression Trees
- Modeling joint health effects of environmental exposure mixtures with Bayesian additive regression trees
- Estimating Heterogeneous Exposure Effects in the Case-Crossover Design Using BART
- On mixing rates for Bayesian CART
- Augmentation Samplers for Multinomial Probit Bayesian Additive Regression Trees
- A high-dimensional additive nonparametric model
- Generalized Bayesian Additive Regression Trees Models: Beyond Conditional Conjugacy
- New directions in algebraic statistics: three challenges from 2023
- Bayesian additive regression trees and the general BART model
This page was built for publication: Efficient Metropolis-Hastings proposal mechanisms for Bayesian regression tree models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q516518)
