Process-based risk measures and risk-averse control of discrete-time systems

DOI10.1007/S10107-018-1349-2zbMATH Open1489.90077arXiv1411.2675OpenAlexW3121615167WikidataQ128910480 ScholiaQ128910480MaRDI QIDQ2118073FDOQ2118073

Andrzej Ruszczyński, Jingnan Fan

Publication date: 22 March 2022

Published in: Mathematical Programming. Series A. Series B (Search for Journal in Brave)

Abstract: For controlled discrete-time stochastic processes we introduce a new class of dynamic risk measures, which we call process-based. Their main features are that they measure risk of processes that are functions of the history of a base process. We introduce a new concept of conditional stochastic time consistency and we derive the structure of process-based risk measures enjoying this property. We show that they can be equivalently represented by a collection of static law-invariant risk measures on the space of functions of the state of the base process. We apply this result to controlled Markov processes and we derive dynamic programming equations.

Full work available at URL: https://arxiv.org/abs/1411.2675

zbMATH Keywords

dynamic programmingmultistage stochastic programmingtime consistencydynamic risk measures

Mathematics Subject Classification ID

Dynamic programming (90C39) Stochastic programming (90C15) Markov and semi-Markov decision processes (90C40)

Cites Work

• Variational Analysis
• DISTRIBUTION‐INVARIANT RISK MEASURES, INFORMATION, AND DYNAMIC CONSISTENCY
• Title not available (Why is that?)
• Concepts and methods for discrete and continuous time control under uncertainty
• From stochastic dominance to mean-risk models: Semideviations as risk measures
• Title not available (Why is that?)
• Dual Stochastic Dominance and Related Mean-Risk Models
• On consistency of stochastic dominance and mean-semideviation models
• Convex risk measures and the dynamics of their penalty functions
• DYNAMIC INDIFFERENCE VALUATION VIA CONVEX RISK MEASURES
• Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion
• Title not available (Why is that?)
• Set-valued analysis
• Dynamic monetary risk measures for bounded discrete-time processes
• Stationary Ordinal Utility and Impatience
• Representation results for law invariant time consistent functions
• Risk-sensitive Markov control processes
• Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon
• Lectures on stochastic programming. Modeling and theory.
• A class of stochastic programs with decision dependent random elements
• The theory and practice of revenue management
• Coherent multiperiod risk adjusted values and Bellman's principle
• Dynamic coherent risk measures
• COMPOSITION OF TIME-CONSISTENT DYNAMIC MONETARY RISK MEASURES IN DISCRETE TIME
• VALUATIONS AND DYNAMIC CONVEX RISK MEASURES
• More Risk-Sensitive Markov Decision Processes
• Risk-Sensitive Markov Decision Processes
• Risk-averse dynamic programming for Markov decision processes
• Mean, variance and probabilistic criteria in finite Markov decision processes: A review
• Variance-Penalized Markov Decision Processes
• Time consistency of dynamic risk measures
• Time-consistent investment policies in Markovian markets: a case of mean-variance analysis
• Conditional Risk Mappings
• Persistently Optimal Policies in Stochastic Dynamic Programming with Generalized Discounting
• Title not available (Why is that?)
• Markov Decision Problems Where Means Bound Variances
• COHERENT ACCEPTABILITY MEASURES IN MULTIPERIOD MODELS
• Berge's theorem for noncompact image sets
• Risk sensitive control of finite state Markov chains in discrete time, with applications to portfolio management
• Markov decision processes with a new optimality criterion: Discrete time
• A Utility Criterion for Markov Decision Processes
• Risk-sensitive and minimax control of discrete-time, finite-state Markov decision processes
• Explicit solutions for multivariate, discrete-time control problems under uncertainty
• Risk measurement and risk-averse control of partially observable discrete-time Markov systems
• Computational methods for risk-averse undiscounted transient Markov models
• Risk-Averse Control of Undiscounted Transient Markov Models
• Stability Results for Stochastic Programs and Sensors, Allowing for Discontinuous Objective Functions
• On modeling risk in Markov decision processes.
• Algorithmic aspects of mean-variance optimization in Markov decision processes
• Title not available (Why is that?)
• Decision-dependent probabilities in stochastic programs with recourse

Cited In (4)

• An Integrated Transportation Distance between Kernels and Approximate Dynamic Risk Evaluation in Markov Systems
• Markov chains under nonlinear expectation
• Risk filtering and risk-averse control of Markovian systems subject to model uncertainty
• Markov risk mappings and risk-sensitive optimal prediction

   Recommendations

• Risk measurement and risk-averse control of partially observable discrete-time Markov systems 👍 👎
• Title not available (Why is that?) 👍 👎
• Risk-sensitive Markov control processes 👍 👎
• Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon 👍 👎
• Risk filtering and risk-averse control of Markovian systems subject to model uncertainty 👍 👎
• Title not available (Why is that?) 👍 👎
• Risk sensitive control of pure jump processes on a general state space 👍 👎
• On risk sensitive control of regular step Markov processes 👍 👎

This page was built for publication: Process-based risk measures and risk-averse control of discrete-time systems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2118073)