Scientific Applications: An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix

Cited In (16)

Bayesian selection probability estimation for probabilistic Boolean networks
Analysis of Markov Influence Graphs
The jump start power method: a new approach for computing the ergodic projector of a finite Markov chain
Deterministic discrete dynamic programming with discount factor greater than one: Some further results and algorithms
A value-iteration scheme for undiscounted multichain Markov renewal programs
Markov Reward Models and Markov Decision Processes in Discrete and Continuous Time: Performance Evaluation and Optimization
Applications of linear programming theory to existence and uniqueness classes for the Cauchy problem
On diagonal dominance in linear complementarity
Computing a graph's period quadratically by node condensation
Totally expanding multiplicative systems
Policy improvement for perfect information additive reward and additive transition stochastic games with discounted and average payoffs
A dynamic programming approach for finite Markov processes and algorithms for the calculation of the limit matrix in Markov chains
The performance evaluation of a multi-stage JIT production system with stochastic demand and production capacities
An improved algorithm for solving communicating average reward Markov decision processes
Stochastic control of paging in a two-level computer memory
A non-recursive algorithm for classifying the states of a finite Markov chain

This page was built for publication: Scientific Applications: An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5567482)