Fastest Mixing Markov Chain on a Graph

From MaRDI portal





The connected graph \(G=(V,E)\) with vertex set \(V=\{1,\dots,n\}\) and edge set \(E \subseteq V \times V\) is considered. It is assumed that \(G\) is a symmetric graph with self-loops, i.e. \((i,j) \in E\) iff \((j,i) \in E\) and \((i,i) \in E\) for all \(i\). The discrete-time Markov chain \(X(t) \in V\), \(t=1,2,\dots,\) is described by transition probabilities \(p_{ij} =\text{Prob}(X(t+1)=j\mid X(t)=i)\) subjected to restrictions \(p_{ij}=p_{ji}\) for all \(i,j \in V\) and \(p_{ij}=0\) if \((i,j) \notin E\). This Markov chain has uniform distribution, the convergence to this distribution is determined by the second largest eigenvalue modulus (SLEM) of the transition probability matrix \(P=\| p_{ij}\| \). The problem of minimizing the SLEM of \(P\) is considered and is expressed as a convex semidefinite problem (SDF). It can be solved either by using standard numerical methods for SDFs for modest \(n\) (say, 1000), or by exploiting various types of symmetry and structure in the problem for larger \(n\), or by using the subgradient method for far larger \(n\) (say, 100,000) offered in the article. The fastest mixing chains are compared to those obtained by using two commonly used heuristics: the maximum degree method and Metropolis-Hastings algorithm. For many examples the fastest mixing chains are faster than those obtained by using heuristics methods. The method for obtaining arbitrary good bounds on the the optimal mixing rate is given. Various extensions of this method are described.




Cited in
(only showing first 100 items - show all)


Describes a project that uses

Uses Software






This page was built for publication: Fastest Mixing Markov Chain on a Graph

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4652267)