Scientific Applications: An algorithm for identifying the ergodic subchains and transient states of a stochastic matrix
From MaRDI portal
Publication:5567482
DOI10.1145/364063.364082zbMath0177.45701MaRDI QIDQ5567482
Publication date: 1968
Published in: Communications of the ACM (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1145/364063.364082
Related Items
Analysis of Markov Influence Graphs, Bayesian selection probability estimation for probabilistic Boolean networks, Policy improvement for perfect information additive reward and additive transition stochastic games with discounted and average payoffs, A non-recursive algorithm for classifying the states of a finite Markov chain, On diagonal dominance in linear complementarity, Stochastic control of paging in a two-level computer memory, Applications of linear programming theory to existence and uniqueness classes for the Cauchy problem, The jump start power method: a new approach for computing the ergodic projector of a finite Markov chain, The performance evaluation of a multi-stage JIT production system with stochastic demand and production capacities, Computing a graph's period quadratically by node condensation, Totally expanding multiplicative systems, An improved algorithm for solving communicating average reward Markov decision processes, Markov Reward Models and Markov Decision Processes in Discrete and Continuous Time: Performance Evaluation and Optimization, A dynamic programming approach for finite Markov processes and algorithms for the calculation of the limit matrix in Markov chains, A value-iteration scheme for undiscounted multichain Markov renewal programs, Deterministic discrete dynamic programming with discount factor greater than one: Some further results and algorithms
