Maximal Invariant Set Computation and Design for Markov Chains

From MaRDI portal
Publication:6318142

arXiv1905.00947MaRDI QIDQ6318142FDOQ6318142


Authors: Dylan Janak, Behçet Açıkmeşe Edit this on Wikidata


Publication date: 2 May 2019

Abstract: We describe an algorithm for computing the maximal invariant set for a Markov chain with linear safety constraints on the distribution over states. We then propose a Markov chain synthesis method that guarantees finite determination of the maximal invariant set. Although this problem is bilinear in the general case, we are able to optimize the convergence rate to a desirable steady-state distribution over reversible Markov chains by solving a Semidefinite Program (SDP), which promotes efficient computation of the maximal invariant set. We then demonstrate this approach with a decentralized swarm guidance application subject to density upper bounds.













This page was built for publication: Maximal Invariant Set Computation and Design for Markov Chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6318142)