Efficient approximation of optimal control for continuous-time Markov games

DOI10.1016/J.IC.2015.12.002MaRDI QIDQ259052zbMATH OpenOpenAlexFDO

Authors John Fearnley, Markus Rabe, Sven Schewe, Lijun Zhang

Publication date 10 March 2016

Published in Information and Computation (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.ic.2015.12.002

zbMATH Keywords

optimal controlcontinuous-time Markov decision processes and gamesdiscretisation

Mathematics Subject Classification ID

Probability in computer science (algorithm analysis, random structures, phase transitions, etc.) (68Q87) Markov and semi-Markov decision processes (90C40) Stochastic games, stochastic differential games (91A15) Optimal stochastic control (93E20)

Recommendations

• Efficient approximation of optimal control for continuous-time Markov games
• Finite optimal control for time-bounded reachability in CTMDPs and continuous-time Markov games
• Efficient computation of time-bounded reachability probabilities in uniform continuous-time Markov decision processes
• Optimal time-abstract schedulers for CTMDPs and Markov games
• Optimal time-abstract schedulers for CTMDPs and continuous-time Markov games

Cites work

• scientific article; zbMATH DE number 3126094 (Why is no real title available?)
• scientific article; zbMATH DE number 700091 (Why is no real title available?)
• scientific article; zbMATH DE number 3292104 (Why is no real title available?)
• A Characterization of Meaningful Schedulers for Continuous-Time Markov Decision Processes
• A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
• Continuous-time stochastic games with time-bounded reachability
• Continuous-time stochastic games with time-bounded reachability
• Delayed Nondeterminism in Continuous-Time Markov Decision Processes
• Efficient approximation of optimal control for continuous-time Markov games
• Efficient computation of time-bounded reachability probabilities in uniform continuous-time Markov decision processes
• Finite State Continuous Time Markov Decision Processes with a Finite Planning Horizon
• Finite optimal control for time-bounded reachability in CTMDPs and continuous-time Markov games
• Finite state continuous time Markov decision processes with an infinite planning horizon
• Improving time bounded reachability computations in interactive Markov chains
• Interactive Markov chains. And the quest for quantified quality
• Maximal cost-bounded reachability probability on continuous-time Markov decision processes
• Model Checking Interactive Markov Chains
• Numerical analysis of continuous time Markov decision processes over finite horizons
• On the semantics of Markov automata
• Optimal Control of a Continuous-Time Markov Chain with Periodic Transition Probabilities
• Optimal continuous time Markov decisions
• Optimal time-abstract schedulers for CTMDPs and continuous-time Markov games
• Sliding Window Abstraction for Infinite Markov Chains
• Solving Ordinary Differential Equations I
• Towards Performance Prediction of Compositional Models in Industrial GALS Designs

Cited in

(11)

• Efficient approximation of optimal control for continuous-time Markov games
• A uniformization-based algorithm for continuous-time stochastic games model checking
• Optimal continuous time Markov decisions
• Continuous-time stochastic games with time-bounded reachability
• Optimal decisions for continuous time Markov decision processes over finite planning horizons
• Strategy synthesis for zero-sum neuro-symbolic concurrent stochastic games
• On decidability of time-bounded reachability in CTMDPs
• Optimal time-abstract schedulers for CTMDPs and Markov games
• An Accelerated Value/Policy Iteration Scheme for Optimal Control Problems and Games
• Approximate Time Bounded Reachability for CTMCs and CTMDPs: A Lyapunov Approach
• Attracting sets of discrete-time Markovian jump delay systems with stochastic disturbances via impulsive control

Describes a project that uses

Uses Software

• CADP
• MRMC

This page was built for publication: Efficient approximation of optimal control for continuous-time Markov games

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q259052)