Optimal Control of Conditional Value-at-Risk in Continuous Time
From MaRDI portal
Publication:5347544
DOI10.1137/16M1058492zbMATH Open1366.49031arXiv1512.05015MaRDI QIDQ5347544FDOQ5347544
Authors: Christopher W. Miller, Insoon Yang 
Publication date: 24 May 2017
Published in: SIAM Journal on Control and Optimization (Search for Journal in Brave)
Abstract: We consider continuous-time stochastic optimal control problems featuring Conditional Value-at-Risk (CVaR) in the objective. The major difficulty in these problems arises from time-inconsistency, which prevents us from directly using dynamic programming. To resolve this challenge, we convert to an equivalent bilevel optimization problem in which the inner optimization problem is standard stochastic control. Furthermore, we provide conditions under which the outer objective function is convex and differentiable. We compute the outer objective's value via a Hamilton-Jacobi-Bellman equation and its gradient via the viscosity solution of a linear parabolic equation, which allows us to perform gradient descent. The significance of this result is that we provide an efficient dynamic programming-based algorithm for optimal control of CVaR without lifting the state-space. To broaden the applicability of the proposed algorithm, we propose convergent approximation schemes in cases where our key assumptions do not hold and characterize relevant suboptimality bounds. In addition, we extend our method to a more general class of risk metrics, which includes mean-variance and median-deviation. We also demonstrate a concrete application to portfolio optimization under CVaR constraints. Our results contribute an efficient framework for solving time-inconsistent CVaR-based sequential optimization.
Full work available at URL: https://arxiv.org/abs/1512.05015
Recommendations
- Publication:4941708
- Optimal control of the risk process in a regime-switching environment
- scientific article; zbMATH DE number 48691
- Optimal risk control under functionally restricted perturbation
- Stochastic optimal control of risk processes with Lipschitz payoff functions
- Conditional value-at-risk: optimization approach
- scientific article; zbMATH DE number 1537583
- Stochastic control of optimized certainty equivalents
- Continuous-time optimal portfolio under a value-at-risk constraint
dynamic programmingrisk measuresHamilton-Jacobi-Bellman equationsstochastic optimal controlviscosity solutionsconditional value-at-risktime inconsistency
Dynamic programming (90C39) Dynamic programming in optimal control and differential games (49L20) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25) Financial applications of other theories (91G80) Optimal stochastic control (93E20)
Cites Work
- Title not available (Why is that?)
- Coherent measures of risk
- Title not available (Why is that?)
- Convex Analysis
- Elliptic partial differential equations of second order
- On the Hamilton-Jacobi-Bellman equations
- From stochastic dominance to mean-risk models: Semideviations as risk measures
- An adaptive sparse grid semi-Lagrangian scheme for first order Hamilton-Jacobi Bellman equations
- Controlled Markov processes and viscosity solutions
- Title not available (Why is that?)
- Parabolic and Elliptic Equations with VMO Coefficients
- Semiconcave functions, Hamilton-Jacobi equations, and optimal control
- DYNAMIC INDIFFERENCE VALUATION VIA CONVEX RISK MEASURES
- Optimal stochastic control, stochastic target problems, and backward SDE.
- Title not available (Why is that?)
- Dynamic monetary risk measures for bounded discrete-time processes
- Conditional value at risk and related linear programming models for portfolio optimization
- On weak uniqueness for some diffusions with discontinuous coefficients
- Convexity of the cost functional in an optimal control problem for a class of positive switched systems
- Nonuniqueness for Second-Order Elliptic Equations with Measurable Coefficients
- Theory of constant proportion portfolio insurance
- Coherent multiperiod risk adjusted values and Bellman's principle
- Risk-Sensitive Control on an Infinite Time Horizon
- Optimization of Convex Risk Functions
- Dynamic coherent risk measures
- An introduction to stochastic differential equations
- RISK MEASURES AND CAPITAL REQUIREMENTS FOR PROCESSES
- Risk-averse dynamic programming for Markov decision processes
- Multi-grid methods for Hamilton-Jacobi-Bellman equations
- Elliptic and parabolic equations with measurable coefficients in weighted Sobolev spaces
- Parabolic equations with measurable coefficients. II.
- Time-inconsistent multistage stochastic programs: martingale bounds
- Title not available (Why is that?)
- Uniqeness results for fully nonlinear degenerate elliptic equations with discontinuous coefficients
- On the solution of nonlinear hyperbolic differential equations by finite differences
- Dynamic approaches for some time-inconsistent optimization problems
- Second order elliptic equations in \(\mathbb{R}^{d}\) with piecewise continuous coefficients
- Risk-sensitive control and dynamic games for partially observed discrete-time nonlinear systems
- Convex Control Systems and Convex Optimal Control Problems With Constraints
- An introduction to viscosity solutions for fully nonlinear PDE with applications to calculus of variations in \(L^\infty\)
- Markov decision processes with average-value-at-risk criteria
- Optimal mean-variance portfolio selection
- Strong maximum principle for semicontinuous viscosity solutions of nonlinear partial differential equations
- Risk-averse control of undiscounted transient Markov models
- Time-inconsistent portfolio investment problems
- Optimal control of a multistate failure-prone manufacturing system under a conditional value-at-risk cost criterion
- Minimum average value-at-risk for finite horizon semi-Markov decision processes in continuous time
- Nonlinear PDE approach to time-inconsistent optimal stopping
- Distribution‐constrained optimal stopping
- A convex analytic approach to risk-aware Markov decision processes
- Variance-Constrained Risk Sharing in Stochastic Systems
Cited In (19)
- Risk-Aware Linear Quadratic Control Using Conditional Value-at-Risk
- Optimality conditions in variational form for non-linear constrained stochastic control problems
- Nonconcave Optimal Investment with Value-at-Risk Constraint: An Application to Life Insurance Contracts
- Optimal control and zero-sum game subject to differential equations with Liu processes and random matrices
- Zero-sum stochastic games with the average-value-at-risk criterion
- Policy gradients for CVaR-constrained MDPs
- Robust optimal control using conditional risk mappings in infinite horizon
- Optimal risk control under functionally restricted perturbation
- The surprising robustness of dynamic mean-variance portfolio optimization to model misspecification errors
- On the distribution of terminal wealth under dynamic mean-variance optimal investment strategies
- Nested sampling for uncertainty quantification and rare event estimation
- A stochastic primal-dual method for optimization with conditional value at risk constraints
- Risk-theoretic optimal design of output-feedback controllers via iterative convex relaxations
- Stochastic control of optimized certainty equivalents
- Continuous-time portfolio optimization for absolute return funds
- On the dynamic representation of some time-inconsistent risk measures in a Brownian filtration
- Risk-averse autonomous systems: a brief history and recent developments from the perspective of optimal control
- Management of portfolio depletion risk through optimal life cycle asset allocation
- Multiperiod mean conditional value at risk asset allocation: is it advantageous to be time consistent?
This page was built for publication: Optimal Control of Conditional Value-at-Risk in Continuous Time
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5347544)
