Yet Another Look at Harris’ Ergodic Theorem for Markov Chains
From MaRDI portal
(Redirected from Publication:2904872)
Abstract: The aim of this note is to present an elementary proof of a variation of Harris' ergodic theorem of Markov chains. This theorem, dating back to the fifties essentially states that a Markov chain is uniquely ergodic if it admits a ``small set which is visited infinitely often. This gives an extension of the ideas of Doeblin to the unbounded state space setting. Often this is established by finding a Lyapunov function with ``small level sets. This topic has been studied by many authors (cf. Harris, Hasminskii, Nummelin, Meyn and Tweedie). If the Lyapunov function is strong enough, one has a spectral gap in a weighted supremum norm (cf. Meyn and Tweedie). Traditional proofs of this result rely on the decomposition of the Markov chain into excursions away from the small set and a careful analysis of the exponential tail of the length of these excursions. There have been other variations which have made use of Poisson equations or worked at getting explicit constants. The present proof is very direct, and relies instead on introducing a family of equivalent weighted norms indexed by a parameter and to make an appropriate choice of this parameter that allows to combine in a very elementary way the two ingredients (existence of a Lyapunov function and irreducibility) that are crucial in obtaining a spectral gap. The original motivation of this proof was the authors' work on spectral gaps in Wasserstein metrics. The proof presented in this note is a version of our reasoning in the total variation setting which we used to guide the calculations in arXiv:math/0602479. While we initially produced it for that purpose, we hope that it will be of interest in its own right.
Cited in
(only showing first 100 items - show all)- Quantitative contraction rates for Markov chains on general state spaces
- Probabilistic and piecewise deterministic models in biology
- Convergence of contrastive divergence algorithm in exponential family
- Perturbation bounds for Monte Carlo within metropolis via restricted approximations
- On the ergodicity of certain Markov chains in random environments
- Ergodic semi-implicit approximations to periodic measures of stochastic differential equations with locally Lipschitz drifts -- error analysis in Wasserstein distance
- On a class of stochastic partial differential equations with multiple invariant measures
- Strongly self-interacting processes on the circle
- A Harris theorem for enhanced dissipation, and an example of Pierrehumbert
- Improving dynamical properties of metropolized discretizations of overdamped Langevin dynamics
- scientific article; zbMATH DE number 3858118 (Why is no real title available?)
- Exponential ergodicity of a degenerate age-size piecewise deterministic process
- Convergence of the likelihood ratio method for linear response of non-equilibrium stationary states
- Numerical computations of geometric ergodicity for stochastic dynamics
- Statistical learning based on Markovian data maximal deviation inequalities and learning rates
- Fast mixing of Metropolis-Hastings with unimodal targets
- Gaussian approximations for chemostat models in finite and infinite dimensions
- Exponential ergodicity of branching processes with immigration and competition
- Local stationarity and time-inhomogeneous Markov chains
- Controllability implies mixing. I: Convergence in the total variation metric
- Trend to equilibrium for run and tumble equations with non-uniform tumbling kernels
- Asymptotic analysis for the generalized Langevin equation with singular potentials
- Error estimates and variance reduction for nonequilibrium stochastic dynamics
- Non-explosion by Stratonovich noise for ODEs
- Markov-Nash equilibria in mean-field games with discounted cost
- \(V\)-geometrical ergodicity of Markov kernels via finite-rank approximations
- Exponential speed up in Monte Carlo sampling through radial updates
- Decay rates of convergence for Fokker-Planck equations with confining drift
- The method of stochastic characteristics for linear second-order hypoelliptic equations
- Computable bounds for solutions to Poisson's equation and perturbation of Markov kernels
- Lower bounds on the rate of convergence for accept-reject-based Markov chains in Wasserstein and total variation distances
- The \(\Phi_3^4\) measure has sub-Gaussian tails
- Convergence to stationary measures in nonlinear Fokker-Planck-Kolmogorov equations
- Discrete‐time risk sensitive portfolio optimization with proportional transaction costs
- Long run risk sensitive portfolio with general factors
- A note on Harris' ergodic theorem, controllability and perturbations of harmonic networks
- Generating diffusions with fractional Brownian motion
- Transient subtraction: a control variate method for computing transport coefficients
- Moderate deviation principles for bifurcating Markov chains: case of functions dependent of one variable
- The transition from ergodic to explosive behavior in a family of stochastic differential equations
- Hybrid stochastic SIS epidemic models with vaccination: stability of the disease-free state and applications
- Asymptotic behavior of a kinetic approach to the collective dynamics of a rock-paper-scissors binary game
- Scalable approximate MCMC algorithms for the horseshoe prior
- Geometric ergodicity of a bead-spring pair with stochastic Stokes forcing
- Spectral gap for the growth-fragmentation equation via Harris's theorem
- Subgeometric rates of convergence of Markov processes in the Wasserstein metric
- How well do reduced models capture the dynamics in models of interacting neurons?
- An entropic approach for Hamiltonian Monte Carlo: the idealized case
- Nonlinear partial differential equations in neuroscience: from modeling to mathematical theory
- Almost-sure exponential mixing of passive scalars by the stochastic Navier-Stokes equations
- A voltage-conductance kinetic system from neuroscience: probabilistic reformulation and exponential ergodicity
- An ergodic theorem for asymptotically periodic time-inhomogeneous Markov processes, with application to quasi-stationarity with moving boundaries
- Random splitting of fluid models: unique ergodicity and convergence
- Gamma calculus beyond Villani and explicit convergence estimates for Langevin dynamics with singular potentials
- Hypocoercivity properties of adaptive Langevin dynamics
- Convergence of nonequilibrium Langevin dynamics for planar flows
- Poincaré inequalities and hitting times
- A regularity condition and a limit theorem for Harris ergodic Markov chains
- scientific article; zbMATH DE number 7387626 (Why is no real title available?)
- Exponential convergence rates of Markov chains under a weaken minorization condition
- Almost sure convergence rates of adaptive increasingly rare Markov chain Monte Carlo
- Uncertainty quantification for Markov processes via variational principles and functional inequalities
- Asymptotic behaviour of neuron population models structured by elapsed-time
- Constructing sampling schemes via coupling: Markov semigroups and optimal transport
- Numerical simulation of polynomial-speed convergence phenomenon
- Periodic asymptotic dynamics of the measure solutions to an equal mitosis equation
- Convergence towards equilibrium for a model with partial diffusion
- Mixing of Metropolis-adjusted Markov chains via couplings: the high acceptance regime
- Large deviations of empirical measures of diffusions in weighted topologies
- Local statistics and concentration for non-intersecting Brownian bridges with smooth boundary data
- Constrained stochastic games with the average payoff criteria
- Statistical estimation in a randomly structured branching population
- Error analysis of the transport properties of metropolized schemes
- Perturbation theory for Markov chains via Wasserstein distance
- Zero-sum risk-sensitive stochastic games
- A multiple time renewal equation for neural assemblies with elapsed time model
- Robustness of iterated function systems of Lipschitz maps
- How hot can a heat bath get?
- Almost-sure enhanced dissipation and uniform-in-diffusivity exponential mixing for advection-diffusion by stochastic Navier-Stokes
- A law of large numbers for branching Markov processes by the ergodicity of ancestral lineages
- Stochastic neural field model: multiple firing events and correlations
- Ergodic properties of random billiards driven by thermostats
- On fixed gain recursive estimators with discontinuity in the parameters
- Spectral gap for projective processes of linear SPDEs
- On the stability of positive semigroups
- On quantitative hypocoercivity estimates based on Harris-type theorems
- Fractional Fokker-Planck equation with general confinement force
- Using coupling methods to estimate sample quality of stochastic differential equations
- Exponential scalar mixing for the 2D Navier-Stokes equations with degenerate stochastic forcing
- Convergence rate to equilibrium in Wasserstein distance for reflected jump-diffusions
- Exponential mixing for Hamiltonian shear flow
- Exponential ergodicity for SDEs and McKean-Vlasov processes with Lévy noise
- Existence and stability of non-equilibrium steady states of a weakly non-linear kinetic Fokker-Planck equation in a domain
- Error analysis of modified Langevin dynamics
- Ergodicity of inhomogeneous Markov processes under general criteria
- Geometric ergodicity of the bouncy particle sampler
- On the Asymptotic Behavior of a Run and Tumble Equation for Bacterial Chemotaxis
- Long-run risk sensitive dyadic impulse control
- Exponential mixing for random dynamical systems and an example of Pierrehumbert
- Long time behavior of an age- and leaky memory-structured neuronal population equation
This page was built for publication: Yet Another Look at Harris’ Ergodic Theorem for Markov Chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2904872)
