Markov decision processes with iterated coherent risk measures

DOI10.1080/00207179.2014.909947MaRDI QIDQ2938604zbMATH OpenOpenAlexFDO

Authors Shanyun Chu, Yi Zhang

Publication date 14 January 2015

Published in International Journal of Control (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1080/00207179.2014.909947

zbMATH Keywords

Markov decision processoptimality equationiterated coherent risk measure

Mathematics Subject Classification ID

Dynamic programming in optimal control and differential games (49L20) Markov and semi-Markov decision processes (90C40) Optimal stochastic control (93E20)

Recommendations

• Markov decision processes with recursive risk measures
• Risk-averse dynamic programming for Markov decision processes
• More risk-sensitive Markov decision processes
• Markov decision processes under ambiguity
• Risk-sensitive Markov control processes

Cites work

• scientific article; zbMATH DE number 1348599 (Why is no real title available?)
• scientific article; zbMATH DE number 3320878 (Why is no real title available?)
• A note on negative dynamic programming for risk-sensitive control
• A selection theorem for optimization problems
• AN OLD‐NEW CONCEPT OF CONVEX RISK MEASURES: THE OPTIMIZED CERTAINTY EQUIVALENT
• Berge's theorem for noncompact image sets
• Coherent measures of risk
• Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
• Constrained Markovian decision processes: The dynamic programming approach
• Discounted dynamic programming with unbounded returns: application to economic models
• Markov control process with the expected total cost criterion: Optimality, stability, and transient models
• Markov decision processes with applications to finance.
• Markov decision processes with average-value-at-risk criteria
• Mean-Variance Criteria for Finite Continuous-Time Markov Decision Processes
• More risk-sensitive Markov decision processes
• Nonstationary discrete-time deterministic and stochastic control systems with infinite horizon
• Nonstationary discrete-time deterministic and stochastic control systems: bounded and unbounded cases
• Risk-averse dynamic programming for Markov decision processes
• Risk-sensitive Markov control processes
• Stochastic games with unbounded payoffs: applications to robust control in economics
• The Iterated Cte
• Time consistent dynamic risk measures

Cited in

(16)

• Conditionally Elicitable Dynamic Risk Measures for Deep Reinforcement Learning
• Uniform Fatou's lemma
• An active-set strategy to solve Markov decision processes with good-deal risk measure
• An average-value-at-risk criterion for Markov decision processes with unbounded costs
• Fatou's lemma for weakly converging measures under the uniform integrability condition
• Robust optimal control using conditional risk mappings in infinite horizon
• Markov decision processes under ambiguity
• Risk measurement and risk-averse control of partially observable discrete-time Markov systems
• Reinforcement learning with dynamic convex risk measures
• Risk-sensitive Markov decision under risk constraints with coherent risk measures
• Sequential Decision Making With Coherent Risk
• A note on a new class of recursive utilities in Markov decision processes
• Markov decision processes with recursive risk measures
• A convex analytic approach to risk-aware Markov decision processes
• Minimizing spectral risk measures applied to Markov decision processes
• Markov decision processes with risk-sensitive criteria: an overview

This page was built for publication: Markov decision processes with iterated coherent risk measures

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2938604)