Exact sampling for intractable probability distributions via a Bernoulli factory
From MaRDI portal
Publication:1950803
Abstract: Many applications in the field of statistics require Markov chain Monte Carlo methods. Determining appropriate starting values and run lengths can be both analytically and empirically challenging. A desire to overcome these problems has led to the development of exact, or perfect, sampling algorithms which convert a Markov chain into an algorithm that produces i.i.d. samples from the stationary distribution. Unfortunately, very few of these algorithms have been developed for the distributions that arise in statistical applications, which typically have uncountable support. Here we study an exact sampling algorithm using a geometrically ergodic Markov chain on a general state space. Our work provides a significant reduction to the number of input draws necessary for the Bernoulli factory, which enables exact sampling via a rejection sampling approach. We illustrate the algorithm on a univariate Metropolis-Hastings sampler and a bivariate Gibbs sampler, which provide a proof of concept and insight into hyper-parameter selection. Finally, we illustrate the algorithm on a Bayesian version of the one-way random effects model with data from a styrene exposure study.
Recommendations
Cites work
- A Bernoulli factory
- A mixture representation of \(\pi\) with applications in Markov chain Monte Carlo and perfect sampling.
- An interruptible algorithm for perfect sampling via Markov chains
- Batch means and spectral variance estimators in Markov chain Monte Carlo
- Corrigendum to ``Bounds on regeneration times and convergence rates for Markov chains
- Exact Sampling from a Continuous State Space
- Exact sampling with coupled Markov chains and applications to statistical mechanics
- Fast simulation of new coins from old
- General Irreducible Markov Chains and Non-Negative Operators
- General state space Markov chains and MCMC algorithms
- Geometric Convergence Rates for Stochastically Ordered Markov Chains
- Geometric ergodicity of Gibbs and block Gibbs samplers for a hierarchical random effects model
- Honest exploration of intractable probability distributions via Markov chain Monte Carlo.
- How to couple from the past using a read-once source of randomness
- scientific article; zbMATH DE number 5954259 (Why is no real title available?)
- scientific article; zbMATH DE number 1350773 (Why is no real title available?)
- scientific article; zbMATH DE number 1522706 (Why is no real title available?)
- Markov chain Monte Carlo: can we trust the third significant figure?
- Markov chains and stochastic stability
- Minorization Conditions and Convergence Rates for Markov Chain Monte Carlo
- Monte Carlo methods in Bayesian computation
- Monte Carlo strategies in scientific computing
- On the applicability of regenerative simulation in Markov chain Monte Carlo
- Perfect sampling using bounding chains.
- Quantitative convergence rates of Markov chains: A simple account
- Regeneration in Markov Chain Samplers
- Simulating events of unknown probabilities via reverse time martingales
- Stationarity detection in the initial transient problem
- Sufficient burn-in for Gibbs samplers for a hierarchical random effects model.
- Using a Markov Chain to Construct a Tractable Approximation of an Intractable Probability Distribution
Cited in
(12)- Barker's algorithm for Bayesian inference with intractable likelihoods
- From the Bernoulli factory to a dice enterprise via perfect sampling of Markov chains
- On nonnegative unbiased estimators
- Combinatorial Bernoulli factories
- Exact Sublinear Binomial Sampling
- scientific article; zbMATH DE number 5954259 (Why is no real title available?)
- Nearly optimal Bernoulli factories for linear functions
- Exact sublinear binomial sampling
- Multiparameter Bernoulli factories
- Metropolis-Hastings transition kernel couplings
- Analyzing Markov chain Monte Carlo output
- Bernoulli factory: the \(2\mathtt{p}\)-coin problem
This page was built for publication: Exact sampling for intractable probability distributions via a Bernoulli factory
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1950803)
