Informed reversible jump algorithms
From MaRDI portal
Abstract: Incorporating information about the target distribution in proposal mechanisms generally produces efficient Markov chain Monte Carlo algorithms (or at least, algorithms that are more efficient than uninformed counterparts). For instance, it has proved successful to incorporate gradient information in fixed-dimensional algorithms, as seen with algorithms such as Hamiltonian Monte Carlo. In trans-dimensional algorithms, Green (2003) recommended to sample the parameter proposals during model switches from normal distributions with informative means and covariance matrices. These proposal distributions can be viewed as asymptotic approximations to the parameter distributions, where the limit is with regard to the sample size. Models are typically proposed using uninformed uniform distributions. In this paper, we build on the approach of Zanella (2020) for discrete spaces to incorporate information about neighbouring models. We rely on approximations to posterior model probabilities that are asymptotically exact. We prove that, in some scenarios, the samplers combining this approach with that of Green (2003) behave like ideal ones that use the exact model probabilities and sample from the correct parameter distributions, in the large-sample regime. We show that the implementation of the proposed samplers is straightforward in some cases. The methodology is applied to a real-data example. The code is available online.
Recommendations
- Efficient Construction of Reversible Jump Markov Chain Monte Carlo Proposal Distributions
- Reversible jump MCMC
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
- Improving the acceptance rate of reversible jump MCMC proposals
- Adaptive proposal construction for reversible jump MCMC
Cites work
- A new Bayesian approach to robustness against outliers in linear regression
- A note on Metropolis-Hastings kernels for general state spaces
- A STATISTICAL PARADOX
- An automatic robust Bayesian approach to principal component regression
- Approximate predictive likelihood
- Asymptotic Statistics
- Bayesian heavy-tailed models and conflict resolution: a review
- Bayesian model averaging: A tutorial. (with comments and a rejoinder).
- Bayesian model selection in high-dimensional settings
- Bayesian robustness to outliers in linear regression and ratio estimation
- Consistency of Bayesian procedures for variable selection
- Efficient Construction of Reversible Jump Markov Chain Monte Carlo Proposal Distributions
- Equation of state calculations by fast computing machines
- Exponential convergence of Langevin distributions and their discrete approximations
- scientific article; zbMATH DE number 1085980 (Why is no real title available?)
- Informed proposals for local MCMC in discrete spaces
- Large-sample asymptotics of the pseudo-marginal method
- Markov chains for exploring posterior distributions. (With discussion)
- MCMC using Hamiltonian dynamics
- Monte Carlo sampling methods using Markov chains and their applications
- Nonreversible Jump Algorithms for Bayesian Nested Model Selection
- Optimal Scaling of Discrete Approximations to Langevin Diffusions
- Optimum Monte-Carlo sampling using Markov chains
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
- Robustness to outliers in location-scale parameter model using log-regularly varying distributions
- The Bernstein-von Mises theorem under misspecification
- The no-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo
Cited in
(8)- Improving the acceptance rate of reversible jump MCMC proposals
- Weak convergence and optimal tuning of the reversible jump algorithm
- Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection
- Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics
- Informed proposals for local MCMC in discrete spaces
- A data-driven reversible jump for estimating a finite mixture of regression models
- Robust heavy-tailed versions of generalized linear models with applications in actuarial science
- Identifying waves of COVID-19 mortality using skew normal curves
This page was built for publication: Informed reversible jump algorithms
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2233560)
