On backward product of stochastic matrices

DOI10.1016/J.AUTOMATICA.2012.05.025MaRDI QIDQ2391435zbMATH OpenOpenAlexFDO

Authors Behrouz Touri, Angelia Nedić

Publication date 31 July 2013

Published in Automatica (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1102.0244, http://www.sciencedirect.com/science/article/pii/S0005109812001987

zbMATH Keywords

ergodicityasymptotic stabilitydistributed controlswitching controldoubly stochastic matricesaveraging controlabsolute infinite flow propertydiscrete inclusion systemsproduct of stochastic matrices

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Stochastic matrices (15B51)

Abstract: We study the ergodicity of backward product of stochastic and doubly stochastic matrices by introducing the concept of absolute infinite flow property. We show that this property is necessary for ergodicity of any chain of stochastic matrices, by defining and exploring the properties of a rotational transformation for a stochastic chain. Then, we establish that the absolute infinite flow property is equivalent to ergodicity for doubly stochastic chains. Furthermore, we develop a rate of convergence result for ergodic doubly stochastic chains. We also investigate the limiting behavior of a doubly stochastic chain and show that the product of doubly stochastic matrices is convergent up to a permutation sequence. Finally, we apply the results to provide a necessary and sufficient condition for the absolute asymptotic stability of a discrete linear inclusion driven by doubly stochastic matrices.

Recommendations

• Product of Random Stochastic Matrices and Distributed Averaging
• On infinite products of stochastic matrices
• Dynamics of a doubly stochastic system
• Ergodicity for products of infinite stochastic matrices
• An ergodic result for the limit of a sequence of substochastic productsxA₁…A_k

Cites work

• scientific article; zbMATH DE number 3117050 (Why is no real title available?)
• scientific article; zbMATH DE number 5454133 (Why is no real title available?)
• scientific article; zbMATH DE number 1531952 (Why is no real title available?)
• Communication constraints in the average consensus problem
• Coordination of groups of mobile autonomous agents using nearest neighbor rules
• Distributed asynchronous deterministic and stochastic gradient optimization algorithms
• Matrix Analysis
• On Distributed Averaging Algorithms and Quantization Effects
• On Ergodicity, Infinite Flow, and Consensus in Random Models
• Products of Indecomposable, Aperiodic, Stochastic Matrices
• Reaching a Consensus
• Reaching a Consensus in a Dynamically Changing Environment: A Graphical Approach
• Stability of discrete linear inclusion
• Towards consensus: some convergence theorems on repeated averaging

Cited in

(11)

• Alternating projection method for intersection of convex sets, multi-agent consensus algorithms, and averaging inequalities
• Distributed fixed point method for solving systems of linear algebraic equations
• A decentralized multi-objective optimization algorithm
• Iterated Proportional Fitting Procedure and Infinite Products of Stochastic Matrices
• Design and analysis of reset strategy for consensus in networks with cluster pattern
• Convergence of max-min consensus algorithms
• Random asynchronous iterations in distributed coordination algorithms
• Phase transitions in the Ising model on a hierarchical random graph based on the triangle
• Topology preservation for multi-agent networks: design and implementation
• Convergence rate of Markov chains over switching distance regular networks
• Dynamics of a doubly stochastic system

This page was built for publication: On backward product of stochastic matrices

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2391435)