Concurrent MDPs with Finite Markovian Policies

DOI10.1007/978-3-030-43024-5_3zbMATH Open1484.68032OpenAlexW3010956653MaRDI QIDQ5014502FDOQ5014502

Authors: Peter Buchholz, Dimitri Scheftelowitsch 

Publication date: 8 December 2021

Published in: Lecture Notes in Computer Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/978-3-030-43024-5_3

Recommendations

• Parallel Markov decision processes
• Constrained continuous-time Markov decision processes on the finite horizon
• On constrained Markov decision processes
• scientific article; zbMATH DE number 7671227
• scientific article; zbMATH DE number 3891132
• Computation of weighted sums of rewards for concurrent MDPs
• Randomized and Past-Dependent Policies for Markov Decision Processes with Multiple Constraints
• Joint chance-constrained Markov decision processes
• scientific article; zbMATH DE number 1348599

zbMATH Keywords

integer linear programmingrobust optimizationoptimal policieslocal search heuristicsconcurrent Markov decision processes

Mathematics Subject Classification ID

Approximation methods and heuristics in mathematical programming (90C59) Performance evaluation, queueing, and scheduling in the context of computer systems (68M20) Integer programming (90C10) Markov and semi-Markov decision processes (90C40) Models and methods for concurrent and distributed computing (process algebras, bisimulation, transition nets, etc.) (68Q85)

Cites Work

• Updating the Inverse of a Matrix
• The Price of Robustness
• 50 Years of Integer Programming 1958-2008
• Scenarios and Policy Aggregation in Optimization Under Uncertainty
• Robust Control of Markov Decision Processes with Uncertain Transition Matrices
• Robust Dynamic Programming
• Technical Note—An Equivalence Between Continuous and Discrete Time Markov Decision Processes
• Title not available (Why is that?)
• Robust Markov Decision Processes
• Markov Decision Processes with Imprecise Transition Probabilities
• Light robustness in the optimization of Markov decision processes with uncertain parameters
• Markovian Decision Processes with Uncertain Transition Probabilities
• Computation of weighted sums of rewards for concurrent MDPs
• Robust product line design
• Robust MDPs with \(k\)-rectangular uncertainty

Cited In (3)

• Computation of weighted sums of rewards for concurrent MDPs
• A continuous-time Markov decision process for infrastructure surveillance
• Markov decision processes with delays and asynchronous cost collection

This page was built for publication: Concurrent MDPs with Finite Markovian Policies

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5014502)