Exact estimation for Markov chain equilibrium expectations
From MaRDI portal
Abstract: We introduce a new class of Monte Carlo methods, which we call exact estimation algorithms. Such algorithms provide unbiased estimators for equilibrium expectations associated with real- valued functionals defined on a Markov chain. We provide easily implemented algorithms for the class of positive Harris recurrent Markov chains, and for chains that are contracting on average. We further argue that exact estimation in the Markov chain setting provides a significant theoretical relaxation relative to exact simulation methods.
Recommendations
Cites work
- A class of unbiased kernel estimates of a probability density function
- A general method for debiasing a Monte Carlo estimator
- A New Approach to the Limit Theory of Recurrent Markov Chains
- Exact sampling with coupled Markov chains and applications to statistical mechanics
- Geometric ergodicity and perfect simulation
- scientific article; zbMATH DE number 1834589 (Why is no real title available?)
- scientific article; zbMATH DE number 1416816 (Why is no real title available?)
- Iterated Random Functions
- Markov chains and stochastic stability
- Multilevel Monte Carlo Path Simulation
- Perfect sampling of ergodic Harris chains
- Perfect simulation for a class of positive recurrent Markov chains
- Simulating the maximum of a random walk
- Stationarity detection in the initial transient problem
- Stochastic simulation: Algorithms and analysis
- Stochastically recursive sequences and their generalizations
- The Asymptotic Efficiency of Simulation Estimators
- Unbiased estimation with square root convergence for SDE models
- Unbiased nonparametric estimation of the derivative of the mean
Cited in
(48)- On Russian roulette estimates for Bayesian inference with doubly-intractable likelihoods
- On the optimal design of the randomized unbiased Monte Carlo estimators
- Unbiased estimation of the gradient of the log-likelihood for a class of continuous-time state-space models
- Unbiased approximation of posteriors via coupled particle Markov chain Monte Carlo
- Unbiased simulation of rare events in continuous time
- On the effective dimension and multilevel Monte Carlo
- Optimal unbiased estimation for expected cumulative discounted cost
- Unbiased Markov chain Monte Carlo for intractable target distributions
- Adaptive Euler-Maruyama method for SDEs with nonglobally Lipschitz drift
- Coupled conditional backward sampling particle filter
- Multi-level Monte Carlo methods for the approximation of invariant measures of stochastic differential equations
- Efficient sampling of conditioned Markov jump processes
- Thinning and multilevel Monte Carlo methods for piecewise deterministic (Markov) processes with an application to a stochastic Morris-Lecar model
- scientific article; zbMATH DE number 1560257 (Why is no real title available?)
- Stochastic modelling of urban structure
- Multilevel estimation of expected exit times and other functionals of stopped diffusions
- Unbiased estimators and multilevel Monte Carlo
- Double Happiness: Enhancing the Coupled Gains of L-lag Coupling via Control Variates
- Unbiased filtering of a class of partially observed diffusions
- Efficient steady-state simulation of high-dimensional stochastic networks
- Smoothing with couplings of conditional particle filters
- Equilibrium in misspecified Markov decision processes
- Constructing sampling schemes via coupling: Markov semigroups and optimal transport
- Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings
- Perfect sampling of the posterior in the hierarchical Pitman-Yor process
- (Non)-penalized multilevel methods for non-uniformly log-concave distributions
- Unbiased Estimation Using Underdamped Langevin Dynamics
- On Unbiased Estimation for Discretized Models
- A randomized multi-index sequential Monte Carlo method
- Unbiased optimal stopping via the MUSE
- General Glivenko-Cantelli theorems
- Computing Bayes: from then `til now
- Burn-in selection in simulating stationary time series
- Metropolis-Hastings transition kernel couplings
- Last passage percolation and limit theorems in Barak-Erdős directed random graphs and related models
- Bounding Wasserstein Distance with Couplings
- Bayesian Structure Learning in Undirected Gaussian Graphical Models: Literature Review with Empirical Comparison
- Solving the Poisson equation using coupled Markov chains
- Nested \(\widehat{R}\): assessing the convergence of Markov chain Monte Carlo when running many short chains
- Debiasing piecewise deterministic Markov process samplers using couplings
- A non-asymptotic error analysis for parallel Monte Carlo estimation from many short Markov chains
- Towards a turnkey approach for unbiased Monte Carlo estimation of smooth functions of expectations
- Unbiased Markov chain quasi-Monte Carlo for Gibbs samplers
- Optimal distributions for randomized unbiased estimators with an infinite horizon and an adaptive algorithm
- Optimization with Markovian noise: towards optimal rates in strong growth case
- Unbiased approximations for stationary distributions of McKean-Vlasov SDEs
- Unbiased kinetic Langevin Monte Carlo with inexact gradients
- Sequential stratified regeneration: \textit{MCMC} for large state spaces with an application to subgraph count estimation
This page was built for publication: Exact estimation for Markov chain equilibrium expectations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5245637)
