Exact estimation for Markov chain equilibrium expectations
From MaRDI portal
Abstract: We introduce a new class of Monte Carlo methods, which we call exact estimation algorithms. Such algorithms provide unbiased estimators for equilibrium expectations associated with real- valued functionals defined on a Markov chain. We provide easily implemented algorithms for the class of positive Harris recurrent Markov chains, and for chains that are contracting on average. We further argue that exact estimation in the Markov chain setting provides a significant theoretical relaxation relative to exact simulation methods.
Recommendations
Cites work
- scientific article; zbMATH DE number 1834589 (Why is no real title available?)
- scientific article; zbMATH DE number 1416816 (Why is no real title available?)
- A New Approach to the Limit Theory of Recurrent Markov Chains
- A class of unbiased kernel estimates of a probability density function
- A general method for debiasing a Monte Carlo estimator
- Exact sampling with coupled Markov chains and applications to statistical mechanics
- Geometric ergodicity and perfect simulation
- Iterated Random Functions
- Markov chains and stochastic stability
- Multilevel Monte Carlo Path Simulation
- Perfect sampling of ergodic Harris chains
- Perfect simulation for a class of positive recurrent Markov chains
- Simulating the maximum of a random walk
- Stationarity detection in the initial transient problem
- Stochastic simulation: Algorithms and analysis
- Stochastically recursive sequences and their generalizations
- The Asymptotic Efficiency of Simulation Estimators
- Unbiased estimation with square root convergence for SDE models
- Unbiased nonparametric estimation of the derivative of the mean
Cited in
(45)- Coupled conditional backward sampling particle filter
- (Non)-penalized multilevel methods for non-uniformly log-concave distributions
- Burn-in selection in simulating stationary time series
- Sequential stratified regeneration: \textit{MCMC} for large state spaces with an application to subgraph count estimation
- Unbiased filtering of a class of partially observed diffusions
- Stochastic modelling of urban structure
- Unbiased Estimation Using Underdamped Langevin Dynamics
- Equilibrium in misspecified Markov decision processes
- Efficient sampling of conditioned Markov jump processes
- Unbiased estimators and multilevel Monte Carlo
- Multilevel estimation of expected exit times and other functionals of stopped diffusions
- Optimal distributions for randomized unbiased estimators with an infinite horizon and an adaptive algorithm
- Metropolis-Hastings transition kernel couplings
- scientific article; zbMATH DE number 1560257 (Why is no real title available?)
- Constructing sampling schemes via coupling: Markov semigroups and optimal transport
- Efficient steady-state simulation of high-dimensional stochastic networks
- A randomized multi-index sequential Monte Carlo method
- Last passage percolation and limit theorems in Barak-Erdős directed random graphs and related models
- Unbiased Markov chain Monte Carlo for intractable target distributions
- On the optimal design of the randomized unbiased Monte Carlo estimators
- Unbiased optimal stopping via the MUSE
- Solving the Poisson equation using coupled Markov chains
- Unbiased simulation of rare events in continuous time
- On the effective dimension and multilevel Monte Carlo
- Multi-level Monte Carlo methods for the approximation of invariant measures of stochastic differential equations
- Nested \(\widehat{R}\): assessing the convergence of Markov chain Monte Carlo when running many short chains
- Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings
- Adaptive Euler-Maruyama method for SDEs with nonglobally Lipschitz drift
- Double Happiness: Enhancing the Coupled Gains of L-lag Coupling via Control Variates
- Unbiased Markov chain quasi-Monte Carlo for Gibbs samplers
- Bounding Wasserstein Distance with Couplings
- Bayesian Structure Learning in Undirected Gaussian Graphical Models: Literature Review with Empirical Comparison
- Optimal unbiased estimation for expected cumulative discounted cost
- Debiasing piecewise deterministic Markov process samplers using couplings
- A non-asymptotic error analysis for parallel Monte Carlo estimation from many short Markov chains
- On Unbiased Estimation for Discretized Models
- Towards a turnkey approach for unbiased Monte Carlo estimation of smooth functions of expectations
- Unbiased approximation of posteriors via coupled particle Markov chain Monte Carlo
- General Glivenko-Cantelli theorems
- Computing Bayes: from then `til now
- Thinning and multilevel Monte Carlo methods for piecewise deterministic (Markov) processes with an application to a stochastic Morris-Lecar model
- Smoothing with couplings of conditional particle filters
- On Russian roulette estimates for Bayesian inference with doubly-intractable likelihoods
- Perfect sampling of the posterior in the hierarchical Pitman-Yor process
- Unbiased estimation of the gradient of the log-likelihood for a class of continuous-time state-space models
This page was built for publication: Exact estimation for Markov chain equilibrium expectations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5245637)
