Spectral and graph-theoretic bounds on steady-state-probability estimation performance for an ergodic Markov chain

DOI10.1016/j.jfranklin.2011.07.010zbMath1274.62552MaRDI QIDQ430187

Mengran Xue, Sandip Roy

Publication date: 21 June 2012

Published in: Journal of the Franklin Institute (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.jfranklin.2011.07.010

Mathematics Subject Classification ID

62M05: Markov processes: estimation; hidden Markov models

60J10: Markov chains (discrete-time Markov processes on discrete state spaces)

15B51: Stochastic matrices

Related Items

State detection from local measurements in network synchronisation processes

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Opportunistic spectrum access in unslotted primary systems
• Topology identification and adaptive synchronization of uncertain complex networks with non-derivative and derivative coupling
• Geometric bounds for eigenvalues of Markov chains
• State and unknown input estimation for discrete time multiple model
• Stochastic fault tolerant control of networked control systems
• On the Markov chain central limit theorem
• New directions in nonlinear observer design. International workshop, Geiranger Fjord, Norway, June 24--26, 1999
• On the structure of stochastic matrices with a subdominant eigenvalue near 1
• Estimating the second largest eigenvalue of a Markov transition matrix
• State estimation for partially observed Markov chains
• Inference in hidden Markov models.
• On nonlinear discrete-time systems driven by Markov chains
• Basecalling using hidden Markov models
• A comparison of some bounds for the nontrivial eigenvalues of stochastic matrices
• Static decentralized control of a single-integrator network with Markovian sensing topology
• The impact of multi-group multi-layer network structure on the performance of distributed consensus building strategies
• Bias and Variance Approximation in Value Function Estimates
• Statistical Inference about Markov Chains
• Maximum likelihood estimation for multivariate observations of Markov sources
• A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle
• Markov Chains
• Strong Consistency of the Variance Estimator in Steady-State Simulation Output Analysis
• Sensitivity of the Stationary Distribution of a Markov Chain
• Asymptotic distribution of smoothed eigenvalue density. II. Wigner random matrices
• Stochastic sampling algorithms for state estimation of jump Markov linear systems
• Fastest Mixing Markov Chain on a Graph
• Statistical Inference for Probabilistic Functions of Finite State Markov Chains
• Monte Carlo sampling methods using Markov chains and their applications
• On controllability with respect to the expectation of discrete time jump linear systems