scientific article; zbMATH DE number 19232

MaRDI QIDQ3976664zbMATH OpenFDO

Authors Eugene Seneta

Publication date 26 June 1992

zbMATH Keywords

ergodicitysensitivity analysisperturbation

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Discrete-time Markov processes on general state spaces (60J05)

Recommendations

• Sensitivity of finite Markov chains under perturbation
• Sensitivity to perturbation of the stationary distribution: Some refinements
• scientific article; zbMATH DE number 6520784
• Sensitivity and convergence of uniformly ergodic Markov chains

Cited in

(24)

• On optimal condition numbers for Markov chains
• On the stability of the computation of the stationary probabilities of Markov chains using Perron complements
• Generalized inverses of Markovian kernels in terms of properties of the Markov chain
• New perturbation bounds for denumerable Markov chains
• Stationary distributions and mean first passage times of perturbed Markov chains
• Concentration of Contractive Stochastic Approximation and Reinforcement Learning
• Pseudometrics for State Aggregation in Average Reward Markov Decision Processes
• Conditioning of the entries in the stationary vector of a Google-type matrix
• Perturbation and Inverse Problems of Stochastic Matrices
• Stationary distribution and perturbation bounds for a stochastic inventory model
• Comparison of perturbation bounds for the stationary distribution of a Markov chain
• Sensitivity of finite Markov chains under perturbation
• Asymptotic expansions for stationary distributions of perturbed semi-Markov processes
• The computation of key properties of Markov chains via perturbations
• Mixing times with applications to perturbed Markov chains
• Off-policy temporal difference learning with distribution adaptation in fast mixing chains
• Dynamic normal forms and dynamic characteristic polynomial
• Markov chain sensitivity measured by mean first passage times
• A structured condition number for Kemeny's constant
• Transition matrices for well-conditioned Markov chains
• scientific article; zbMATH DE number 7446610 (Why is no real title available?)
• Perturbation bounds for Markov chains with general state space
• Strong stability and perturbation bounds for discrete Markov chains
• Sharp entrywise perturbation bounds for Markov chains

This page was built for publication:

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3976664)