Dynamic consistency for stochastic optimal control problems

DOI10.1007/S10479-011-1027-8MaRDI QIDQ1931661zbMATH OpenOpenAlexFDO

Authors Pierre Carpentier, Jean-Philippe Chancelier, Guy Cohen, Michel De Lara, Pierre Girardeau

Publication date 15 January 2013

Published in Annals of Operations Research (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1005.3605

zbMATH Keywords

dynamic consistencyrisk measures

Mathematics Subject Classification ID

Dynamic programming (90C39) Optimal stochastic control (93E20)

Abstract: For a sequence of dynamic optimization problems, we aim at discussing a notion of consistency over time. This notion can be informally introduced as follows. At the very first time step $t_0$, the decision maker formulates an optimization problem that yields optimal decision rules for all the forthcoming time step $t_0,t_1,\mathrm{...},T$; at the next time step $t_1$, he is able to formulate a new optimization problem starting at time $t_1$ that yields a new sequence of optimal decision rules. This process can be continued until final time $T$ is reached. A family of optimization problems formulated in this way is said to be time consistent if the optimal strategies obtained when solving the original problem remain optimal for all subsequent problems. The notion of time consistency, well-known in the field of Economics, has been recently introduced in the context of risk measures, notably by Artzner et al. (2007) and studied in the Stochastic Programming framework by Shapiro (2009) and for Markov Decision Processes (MDP) by Ruszczynski (2009). We here link this notion with the concept of "state variable" in MDP, and show that a significant class of dynamic optimization problems are dynamically consistent, provided that an adequate state variable is chosen.

Recommendations

• Building up time-consistency for risk measures and dynamic optimization
• On a time consistency concept in risk averse multistage stochastic programming
• Time-inconsistent optimal control problems
• Time-inconsistent optimal control problems and related issues
• Dynamic approaches for some time-inconsistent optimization problems

Cites work

• A standard form for sequential stochastic control
• Changing Tastes and Coherent Dynamic Choice
• Coherent multiperiod risk adjusted values and Bellman's principle
• Conditional and dynamic convex risk measures
• Convexity of chance constraints with independent random variables
• Dynamic coherent risk measures
• Dynamic monetary risk measures for bounded discrete-time processes
• scientific article; zbMATH DE number 3889341 (Why is no real title available?)
• scientific article; zbMATH DE number 3126094 (Why is no real title available?)
• scientific article; zbMATH DE number 772850 (Why is no real title available?)
• On a time consistency concept in risk averse multistage stochastic programming
• On Information Structures, Feedback and Causality
• On the connectedness of probabilistic constraint sets
• On the Existence of a Consistent Course of Action when Tastes are Changing
• Richard Bellman on the Birth of Dynamic Programming
• Risk-averse dynamic programming for Markov decision processes
• Temporal Resolution of Uncertainty and Dynamic Choice Theory
• Variational Analysis

Cited in

(23)

• Risk management for forestry planning under uncertainty in demand and prices
• Decomposability and time consistency of risk averse multistage programs
• Minimax and risk averse multistage stochastic programming
• Time consistency of dynamic risk measures
• Time (in)consistency of multistage distributionally robust inventory models with moment constraints
• An application of control theory for imperfect production problem with carbon emission investment policy in interval environment
• The nested Sinkhorn divergence to learn the nested distance
• A survey of time consistency of dynamic risk measures and dynamic performance measures in discrete time: LM-measure perspective
• Structure of risk-averse multistage stochastic programs
• Time-consistent decisions and temporal decomposition of coherent risk functionals
• Stable Optimal Control and Semicontractive Dynamic Programming
• Time-inconsistent multistage stochastic programs: martingale bounds
• Building up time-consistency for risk measures and dynamic optimization
• Risk aversion in multistage stochastic programming: a modeling and algorithmic perspective
• Effective scenarios in multistage distributionally robust optimization with a focus on total variation distance
• Dynamic risked equilibrium
• Controlled Markov decision processes with AVaR criteria for unbounded costs
• scientific article; zbMATH DE number 7733443 (Why is no real title available?)
• Time Consistency for Multistage Stochastic Optimization Problems under Constraints in Expectation
• Stochastic dual dynamic programming and its variants: a review
• Scenario tree reduction via Wasserstein barycenters
• Assortment planning under spectral risk measures
• A combined SDDP/Benders decomposition approach with a risk-averse surface concept for reservoir operation in long term power generation planning

This page was built for publication: Dynamic consistency for stochastic optimal control problems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1931661)