Absorbing Markov decision processes

DOI10.1051/COCV/2024002MaRDI QIDQ6203440zbMATH OpenFDO

Authors F. Dufour, Tomás Prieto-Rumeau

Publication date 28 February 2024

Published in ESAIM: Control, Optimisation and Calculus of Variations (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/2309.07059

zbMATH Keywords

characteristic equationoccupation measuresMarkov decision processesabsorbing modelcompactness of the set of occupation measuresphantom measures

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Recommendations

• Extreme Occupation Measures in Markov Decision Processes with an Absorbing State
• On the continuity of the projection mapping from strategic measures to occupation measures in absorbing Markov decision processes
• Absorbing continuous-time Markov decision processes with total cost criteria
• The critical discount factor for finite Markovian decision processes with an absorbing set
• A convex analytic approach to Markov decision processes

Cites work

• scientific article; zbMATH DE number 3664132 (Why is no real title available?)
• scientific article; zbMATH DE number 1325008 (Why is no real title available?)
• scientific article; zbMATH DE number 1348599 (Why is no real title available?)
• scientific article; zbMATH DE number 1119444 (Why is no real title available?)
• scientific article; zbMATH DE number 1786123 (Why is no real title available?)
• scientific article; zbMATH DE number 3323562 (Why is no real title available?)
• scientific article; zbMATH DE number 3386006 (Why is no real title available?)
• A General Approach to Lower Semicontinuity and Lower Closure in Optimal Control Theory
• Compactness and sequential compactness in spaces of measures
• Examples in Markov decision processes
• Existence of Stationary Correlated Equilibria with Symmetric Information for Discounted Stochastic Games
• Infinite dimensional analysis. A hitchhiker's guide.
• Measure theory. Vol. I and II
• Nash equilibria for total expected reward absorbing Markov games: the constrained and unconstrained cases
• On dynamic programming: Compactness of the space of policies
• On ws-convergence of product measures.
• Splitting randomized stationary policies in total-reward Markov decision processes
• Stationary Markov perfect equilibria in discounted stochastic games
• Sufficiency of deterministic policies for atomless discounted and uniformly absorbing MDPs with multiple criteria
• Young measures and compactness in measure spaces

Cited in

(3)

• On the continuity of the projection mapping from strategic measures to occupation measures in absorbing Markov decision processes
• Constrained Markov decision processes with non-constant discount factor
• Extreme Occupation Measures in Markov Decision Processes with an Absorbing State

This page was built for publication: Absorbing Markov decision processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6203440)