Further Comparisons of Direct Methods for Computing Stationary Distributions of Markov Chains

DOI10.1137/0608020MaRDI QIDQ3028309zbMATH OpenOpenAlexFDO

Authors Daniel P. Heyman

Publication date 1987

Published in SIAM Journal on Algebraic Discrete Methods (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1137/0608020

zbMATH Keywords

Gaussian eliminationdirect methodsergodic statesblock- tridiagonal matricessparsity schemesstationary distribution of an irreducible Markov chain

Mathematics Subject Classification ID

Probabilistic methods, stochastic differential equations (65C99) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Software, source code, etc. for problems pertaining to probability theory (60-04) Continuous-time Markov processes on general state spaces (60J25)

Recommendations

• Comparacion numerica de algoritmos para calcular distribuciones estacionarias de cadenas de Markov finitas
• Comparison of Some Direct Methods for Computing Stationary Distributions of Markov Chains
• scientific article; zbMATH DE number 1424145
• A direct projection method for Markov chains
• scientific article; zbMATH DE number 510835

Cites work

• scientific article; zbMATH DE number 3793743 (Why is no real title available?)
• Comparison of Some Direct Methods for Computing Stationary Distributions of Markov Chains
• Computation of the stationary distribution of a markov chain
• Iterative Methods for Computing Stationary Distributions of Nearly Completely Decomposable Markov Chains
• Matrix Methods for Queuing Problems
• Regenerative Analysis and Steady State Distributions for Markov Chains

Cited in

(13)

• Accurate calculations of stationary distributions and mean first passage times in Markov renewal processes and Markov chains
• Exact algorithms for singular tridiagonal systems with applications to Markov chains
• Comparacion numerica de algoritmos para calcular distribuciones estacionarias de cadenas de Markov finitas
• Computing absorption probabilities for a Markov chain
• A stochastic analysis of the dynamic space utilization in warehouses
• scientific article; zbMATH DE number 1424145 (Why is no real title available?)
• Computing the fundamental matrix for a nonirreducible Markov chain
• Using state reduction for computing steady state vectors in Markov chains of \(M/G/1\) type
• Optimizing steady state Markov chains by state reduction
• The state reduction and related algorithms and their applications to the study of Markov chains, graph theory, and the optimal stopping problem
• The computation of the mean first passage times for Markov chains
• Entrywise perturbation theory and error analysis for Markov chains
• Comparison of Some Direct Methods for Computing Stationary Distributions of Markov Chains

This page was built for publication: Further Comparisons of Direct Methods for Computing Stationary Distributions of Markov Chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3028309)