Yet Another Look at Harris’ Ergodic Theorem for Markov Chains

DOI10.1007/978-3-0348-0021-1_7MaRDI QIDQ2904872zbMATH OpenOpenAlexWikidataFDO

Authors Martin Hairer, Jonathan C. Mattingly

Publication date 24 August 2012

Published in Seminar on Stochastic Analysis, Random Fields and Applications VI (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/0810.2777

zbMATH Keywords

exponential ergodicityHarris theoremMarkov chains

Mathematics Subject Classification ID

Ergodic theorems, spectral theory, Markov operators (37A30) Discrete-time Markov processes on general state spaces (60J05)

Abstract: The aim of this note is to present an elementary proof of a variation of Harris' ergodic theorem of Markov chains. This theorem, dating back to the fifties essentially states that a Markov chain is uniquely ergodic if it admits a ``small set which is visited infinitely often. This gives an extension of the ideas of Doeblin to the unbounded state space setting. Often this is established by finding a Lyapunov function with ``small level sets. This topic has been studied by many authors (cf. Harris, Hasminskii, Nummelin, Meyn and Tweedie). If the Lyapunov function is strong enough, one has a spectral gap in a weighted supremum norm (cf. Meyn and Tweedie). Traditional proofs of this result rely on the decomposition of the Markov chain into excursions away from the small set and a careful analysis of the exponential tail of the length of these excursions. There have been other variations which have made use of Poisson equations or worked at getting explicit constants. The present proof is very direct, and relies instead on introducing a family of equivalent weighted norms indexed by a parameter $$ and to make an appropriate choice of this parameter that allows to combine in a very elementary way the two ingredients (existence of a Lyapunov function and irreducibility) that are crucial in obtaining a spectral gap. The original motivation of this proof was the authors' work on spectral gaps in Wasserstein metrics. The proof presented in this note is a version of our reasoning in the total variation setting which we used to guide the calculations in arXiv:math/0602479. While we initially produced it for that purpose, we hope that it will be of interest in its own right.

Cited in

(only showing first 100 items - show all)

• How hot can a heat bath get?
• Exponential convergence rates of Markov chains under a weaken minorization condition
• Non-equilibrium steady states for networks of oscillators
• Explicit contraction rates for a class of degenerate and infinite-dimensional diffusions
• Numerical simulation of polynomial-speed convergence phenomenon
• Perturbation theory for Markov chains via Wasserstein distance
• Convergence to stationary measures in nonlinear Fokker-Planck-Kolmogorov equations
• A note on Harris' ergodic theorem, controllability and perturbations of harmonic networks
• How well do reduced models capture the dynamics in models of interacting neurons?
• Convergence in variation of solutions of nonlinear Fokker-Planck-Kolmogorov equations to stationary measures
• Constrained stochastic games with the average payoff criteria
• Poincaré inequalities and hitting times
• Perturbation bounds for Monte Carlo within metropolis via restricted approximations
• Fast mixing of Metropolis-Hastings with unimodal targets
• Convergence of contrastive divergence algorithm in exponential family
• Scaling limits for the generalized Langevin equation
• Large deviations of empirical measures of diffusions in weighted topologies
• On a class of stochastic partial differential equations with multiple invariant measures
• Coexistence and exclusion of competitive Kolmogorov systems with semi-Markovian switching
• Gamma calculus beyond Villani and explicit convergence estimates for Langevin dynamics with singular potentials
• Long-run risk sensitive dyadic impulse control
• Efficient stochastic optimisation by unadjusted Langevin Monte Carlo. Application to maximum marginal likelihood and empirical Bayesian estimation
• More on the long time stability of Feynman-Kac semigroups
• Convergence of Markov chain transition probabilities
• Exponential ergodicity for SDEs and McKean-Vlasov processes with Lévy noise
• Generating diffusions with fractional Brownian motion
• Invariant measures for multidimensional fractional stochastic volatility models
• Mixing rates for Hamiltonian Monte Carlo algorithms in finite and infinite dimensions
• Sup-norm adaptive drift estimation for multivariate nonreversible diffusions
• The \(\Phi_3^4\) measure has sub-Gaussian tails
• Wasserstein-based methods for convergence complexity analysis of MCMC with applications
• Almost-sure exponential mixing of passive scalars by the stochastic Navier-Stokes equations
• Periodic asymptotic dynamics of the measure solutions to an equal mitosis equation
• Strict Kantorovich contractions for Markov chains and Euler schemes with general noise
• Existence, uniqueness and exponential ergodicity under Lyapunov conditions for McKean-Vlasov SDEs with Markovian switching
• Hypocoercivity of linear kinetic equations via Harris's theorem
• \(V\)-geometrical ergodicity of Markov kernels via finite-rank approximations
• Convergence rate to equilibrium in Wasserstein distance for reflected jump-diffusions
• Non-explosion by Stratonovich noise for ODEs
• Statistical learning based on Markovian data maximal deviation inequalities and learning rates
• A perturbation analysis of Markov chains models with time-varying parameters
• Ergodicity and stability of a dynamical system perturbed by impulsive random interventions
• On convergence to stationary distributions for solutions of nonlinear Fokker-Planck-Kolmogorov equations
• Statistical estimation in a randomly structured branching population
• Local stationarity and time-inhomogeneous Markov chains
• Convergence complexity analysis of Albert and Chib's algorithm for Bayesian probit regression
• A new approach to the existence of invariant measures for Markovian semigroups
• Error estimates on ergodic properties of discretized Feynman-Kac semigroups
• Couplings and quantitative contraction rates for Langevin dynamics
• Stochastic neural field model: multiple firing events and correlations
• Exponential ergodicity for Markov processes with random switching
• Langevin dynamics with space-time periodic nonequilibrium forcing
• Ergodic properties of random billiards driven by thermostats
• Gaussian approximations for chemostat models in finite and infinite dimensions
• Autoregressive functions estimation in nonlinear bifurcating autoregressive models
• Subgeometric rates of convergence of Markov processes in the Wasserstein metric
• A regularity condition and a limit theorem for Harris ergodic Markov chains
• Quantitative contraction rates for Markov chains on general state spaces
• Geometric ergodicity of the bouncy particle sampler
• Almost-sure enhanced dissipation and uniform-in-diffusivity exponential mixing for advection-diffusion by stochastic Navier-Stokes
• Uniform exponential contraction for viscous Hamilton-Jacobi equations
• The method of stochastic characteristics for linear second-order hypoelliptic equations
• Harris-type results on geometric and subgeometric convergence to equilibrium for stochastic semigroups
• Long run risk sensitive portfolio with general factors
• Statistical estimation of jump rates for a piecewise deterministic Markov processes with deterministic increasing motion and jump mechanism
• Error analysis of modified Langevin dynamics
• scientific article; zbMATH DE number 3858118 (Why is no real title available?)
• Spectral gap for the growth-fragmentation equation via Harris's theorem
• Stability of noisy Metropolis-Hastings
• Long time behavior of Markov processes
• Existence of nonequilibrium steady state for a simple model of heat conduction
• The transition from ergodic to explosive behavior in a family of stochastic differential equations
• Markov-Nash equilibria in mean-field games with discounted cost
• Controllability implies mixing. I: Convergence in the total variation metric
• Probabilistic and piecewise deterministic models in biology
• Asymptotic behaviour of neuron population models structured by elapsed-time
• Quantitative Harris-type theorems for diffusions and McKean-Vlasov processes
• Comparison of asymptotic variances of inhomogeneous Markov chains with application to Markov chain Monte Carlo methods
• Langevin dynamics with general kinetic energies
• Convergence rate and concentration inequalities for Gibbs sampling in high dimension
• Convergence of the likelihood ratio method for linear response of non-equilibrium stationary states
• Uncertainty quantification for Markov processes via variational principles and functional inequalities
• On fixed gain recursive estimators with discontinuity in the parameters
• Scalable approximate MCMC algorithms for the horseshoe prior
• scientific article; zbMATH DE number 7387626 (Why is no real title available?)
• Convergence of Recursive Stochastic Algorithms Using Wasserstein Divergence
• Weighted \(L^2\)-contractivity of Langevin dynamics with singular potentials
• Efficient Numerical Algorithms for the Generalized Langevin Equation
• A multiple time renewal equation for neural assemblies with elapsed time model
• Strongly self-interacting processes on the circle
• Moderate deviation principles for bifurcating Markov chains: case of functions dependent of one variable
• Long time behavior of an age- and leaky memory-structured neuronal population equation
• Hypocoercivity properties of adaptive Langevin dynamics
• Kinetic walks for sampling
• A Bayesian Approach to Estimating Background Flows from a Passive Scalar
• Inert drift system in a viscous fluid: steady state asymptotics and exponential ergodicity
• The mean-field equation of a leaky integrate-and-fire neural network: measure solutions and steady states
• Numerical computations of geometric ergodicity for stochastic dynamics
• Using coupling methods to estimate sample quality of stochastic differential equations
• A Perturbative Approach to Control Variates in Molecular Dynamics

This page was built for publication: Yet Another Look at Harris’ Ergodic Theorem for Markov Chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2904872)