scientific article; zbMATH DE number 549928

MaRDI QIDQ4287439zbMATH OpenFDO

Authors Ravi Varadarajan

Publication date 12 April 1994

zbMATH Keywords

complexity of algorithmsdiscrete-time finite state Markov processesmatrix representationsmodels of computationmulti-edge graphsparallel algorithmssequential algorithmsshared memory and hypercube parallel computers

Mathematics Subject Classification ID

Discrete-time Markov processes on general state spaces (60J05) Probabilistic methods, stochastic differential equations (65C99) Parallel numerical computation (65Y05) Complexity and performance of numerical algorithms (65Y20)

Recommendations

• A dynamic programming approach for finite Markov processes and algorithms for the calculation of the limit matrix in Markov chains
• Algorithms for Markov stochastic models
• Algorithms for determining the state-time probabilities and the limit matrix in Markov chains
• The Complexity of Markov Decision Processes
• Finite state approximation algorithms for average cost denumerable state Markov decision processes

Cited in

(13)

• Algorithms for an irreducible and lumpable strong stochastic bound
• Parallel computing for Markov chains with islands and ports
• Analysis of probabilistic processes and automata theory
• The behavior of a Markov network with respect to an absorbing class: the target algorithm
• scientific article; zbMATH DE number 3911726 (Why is no real title available?)
• Independent markov processes in parallel
• The Complexity of Markov Decision Processes
• scientific article; zbMATH DE number 19236 (Why is no real title available?)
• scientific article; zbMATH DE number 510828 (Why is no real title available?)
• On the Generation of Markov Decision Processes
• Performance Issues for the Iterative Solution of Markov Decision Processes on Parallel Computers
• Solving Markov decision processes by \(d\)-graph algorithms
• Algorithms for Markov stochastic models

This page was built for publication:

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4287439)