The computation of key properties of Markov chains via perturbations

DOI10.1016/j.laa.2016.09.004zbMath1352.15037arXiv1602.05247OpenAlexW2286096857MaRDI QIDQ331164

Jeffrey J. Hunter

Publication date: 26 October 2016

Published in: Linear Algebra and its Applications (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1602.05247

zbMATH Keywords

algorithmnumerical examplesMarkov chaingroup inversestochastic matrixstationary distributionsgeneralised matrix inversesmoments of first passage times

Mathematics Subject Classification ID

Theory of matrix inversion and generalized inverses (15A09) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Numerical analysis or methods applied to Markov chains (65C40) Stochastic matrices (15B51)

Related Items (3)

The time-dependent expected reward and deviation matrix of a finite QBD process ⋮ The computation of the mean first passage times for Markov chains ⋮ Finite capacity single-server queue with Poisson input, general service and delayed renovation

Cites Work

• Accurate calculations of stationary distributions and mean first passage times in Markov renewal processes and Markov chains
• Parametric forms for generalized inverses of Markovian kernels and their applications
• Stationary distributions of perturbed Markov chains
• Characterizations of generalized inverses associated with Markovian kernels
• Generalized inverses and their application to applied probability problems
• Generalized inverses of Markovian kernels in terms of properties of the Markov chain
• Mixing times with applications to perturbed Markov chains
• The computation of stationary distributions of Markov chains through perturbations
• Probabilistic approach to Perron root, the group inverse, and applications
• SIMPLE PROCEDURES FOR FINDING MEAN FIRST PASSAGE TIMES IN MARKOV CHAINS
• Technical Note—A Markov Chain Partitioning Algorithm for Computing Steady State Probabilities
• Regenerative Analysis and Steady State Distributions for Markov Chains
• Updating $LU$ Factorizations for Computing Stationary Distributions
• Numerical computation of mean passage times and absorption probabilities in Markov and Semi-Markov models
• Updating finite markov chains by using techniques of group matrix inversion
• The Condition of a Finite Markov Chain and Perturbation Bounds for the Limiting Probabilities
• Numerical Solution of Linear Equations Arising in Markov Chain Models
• The Role of the Group Generalized Inverse in the Theory of Finite Markov Chains
• Computation of the stationary distribution of a markov chain
• Updating Markov Chains with an Eye on Google's PageRank
• On the moments of Markov renewal processes
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: The computation of key properties of Markov chains via perturbations