Convergence analysis of some multivariate Markov chains using stochastic monotonicity
Consider a discrete-time Markov chain with a finite state space, transition probability density \(K(x,x')\) and stationary distribution \(\pi(x)\). Let \[ \|K_x^n-\pi\|_{TV}=0.5 \sum_{x' \in X} |K^n(x,x')-\pi(x')| \] denote the total variation distance between the density of the chain after \(n\) steps and the stationary density. The authors provide a nonasymptotic analysis of convergence to stationarity for a collection of Markov chains thereby generalizing results in [\textit{K. Khare} and \textit{H. Zhou}, Ann. Appl. Probab. 19, No. 2, 737--777 (2009; Zbl 1171.60016)]. This allows essentially to improve crude upper bounds of convergence. For example, the obtained estimate for sequential Pólya urn model is the following \[ 0.375 (1-1/111)^n \leq \|K_x^n-\pi\|_{TV}\leq 100 (1-1/111)^n, \] while the crude upper bound is \(\|K_x^n-\pi\|_{TV} \leq 2.2186\times 10^{19} (1-1/111)^n\). Examples include the multi-allele Moran model in population genetics and its variants in community ecology, a generalized Ehrenfest urn model and variants of the Pólya urn model. It is shown that all these Markov chains are stochastically monotone with respect to an appropriate partial ordering. This allows to obtain explicit nonasymptotic bounds for distance to stationarity from arbitrary starting points. Note that, in previous works, bounds, if any, were available only from special starting points. The analysis also works for nonreversible Markov chains.
- Rates of convergence of some multivariate Markov chains with polynomial eigenfunctions
- scientific article; zbMATH DE number 4052721
- Convergence to stationarity in the Moran model
- Convergence of independent particle systems
- Some things we've learned (about Markov chain Monte Carlo)
- A local limit theorem for a family of non-reversible Markov chains
- Stability and exponential convergence of continuous-time Markov chains
- Convergence of Slice Sampler Markov Chains
- Convergence time to the Ewens sampling formula in the infinite alleles Moran model
- Convergence to stationarity in the Moran model
- Geometric Convergence Rates for Stochastically Ordered Markov Chains
- Gibbs sampling, conjugate priors and coupling
- How to Get a Perfectly Random Sample from a Generic Markov Chain and Generate a Random Spanning Tree of a Directed Graph
- scientific article; zbMATH DE number 3148873 (Why is no real title available?)
- scientific article; zbMATH DE number 3852171 (Why is no real title available?)
- Mathematical population genetics. I: Theoretical introduction.
- Mixing times of lozenge tiling and card shuffling Markov chains
- On the convergence of the Markov chain simulation method
- One-shot CFTP; application to a class of truncated Gaussian densities
- Rates of convergence of some multivariate Markov chains with polynomial eigenfunctions
- Stochastic inequalities on partially ordered spaces
- Stochastic monotonicity and realizable monotonicity
- Rates of convergence of some multivariate Markov chains with polynomial eigenfunctions
- Cutoff for the Bernoulli-Laplace urn model with o(n) swaps
- On the limitations of single-step drift and minorization in Markov chain convergence analysis
- An introduction to multivariate Krawtchouk polynomials and their applications
- Analysis of non-reversible Markov chains via similarity orbits
- A voter-model representation of the multi-allelic Moran process: exact stationary distributions and diversity thresholds from well-mixed populations to complex networks
This page was built for publication: Convergence analysis of some multivariate Markov chains using stochastic monotonicity
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1948704)