Of cores: a partial-exploration framework for Markov decision processes

DOI10.4230/LIPICS.CONCUR.2019.5MaRDI QIDQ5875366zbMATH OpenFDO

Authors Jan Křetínský, Tobias Meggendorfer

Publication date 3 February 2023

zbMATH Keywords

approximationreachabilityMarkov decision processes

Mathematics Subject Classification ID

Models and methods for concurrent and distributed computing (process algebras, bisimulation, transition nets, etc.) (68Q85)

Recommendations

• Of cores: a partial-exploration framework for Markov decision processes
• Continuous-time Markov decisions based on partial exploration
• Verification of Markov decision processes using learning algorithms
• CEGAR for compositional analysis of qualitative properties in Markov decision processes

Cites work

• scientific article; zbMATH DE number 3128787 (Why is no real title available?)
• scientific article; zbMATH DE number 700091 (Why is no real title available?)
• scientific article; zbMATH DE number 2087806 (Why is no real title available?)
• scientific article; zbMATH DE number 2090703 (Why is no real title available?)
• scientific article; zbMATH DE number 2090709 (Why is no real title available?)
• scientific article; zbMATH DE number 5585443 (Why is no real title available?)
• Continuous-time Markov decisions based on partial exploration
• Dynamic programming and optimal control. Vol. 2
• Of cores: a partial-exploration framework for Markov decision processes
• Performance analysis of probabilistic timed automata using digital clocks
• Reachability in MDPs: refining convergence of value iteration
• Sound value iteration
• The complexity of probabilistic verification
• Value iteration for long-run average reward in Markov decision processes
• Verification of Markov decision processes using learning algorithms

Cited in

(3)

• Of cores: a partial-exploration framework for Markov decision processes
• Comparison of algorithms for simple stochastic games
• Of cores: a partial-exploration framework for Markov decision processes

Describes a project that uses

Uses Software

• PRISM
• PASS
• Storm

This page was built for publication: Of cores: a partial-exploration framework for Markov decision processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5875366)