Markov decision processes and regular events

DOI10.1007/BFB0032043MaRDI QIDQ4038703zbMATH OpenFDO

Authors Mihalis Yannakakis, Costas Courcoubetis

Publication date 18 May 1993

Published in Lecture Notes in Computer Science (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/BFB0032043

zbMATH Keywords

\(\omega\)- regular setsautomata on infinite wordsconcurrent probabilistic programscontrolled Markov chainsoptimal decision strategies for MDP

Mathematics Subject Classification ID

Formal languages and automata (68Q45) Specification and verification (program logics, model checking, etc.) (68Q60)

Recommendations

• Markov decision processes and regular events
• scientific article; zbMATH DE number 1786649
• On the complexity of finite memory policies for Markov decision processes
• scientific article; zbMATH DE number 4154239
• Markov decision processes

Cited in

(15)

• Spanning the spectrum from safety to liveness
• Quantitative solution of omega-regular games
• Optimal schedulers vs optimal bases: an approach for efficient exact solving of Markov decision processes
• Synthesizing efficient controllers
• Randomization in automata on infinite trees
• Compositional probabilistic verification through multi-objective model checking
• The complexity of stochastic Müller games
• Markov decision processes and regular events
• Converging from branching to linear metrics on Markov chains
• Temporal logics for the specification of performance and reliability
• Model checking linear-time properties of probabilistic systems
• Stochastic Müller Games are PSPACE-Complete
• Symbolic control for stochastic systems via finite parity games
• Submixing and shift-invariant stochastic games
• Regular decision processes

This page was built for publication: Markov decision processes and regular events

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4038703)