Optimal Control of Conditional Value-at-Risk in Continuous Time
From MaRDI portal
Abstract: We consider continuous-time stochastic optimal control problems featuring Conditional Value-at-Risk (CVaR) in the objective. The major difficulty in these problems arises from time-inconsistency, which prevents us from directly using dynamic programming. To resolve this challenge, we convert to an equivalent bilevel optimization problem in which the inner optimization problem is standard stochastic control. Furthermore, we provide conditions under which the outer objective function is convex and differentiable. We compute the outer objective's value via a Hamilton-Jacobi-Bellman equation and its gradient via the viscosity solution of a linear parabolic equation, which allows us to perform gradient descent. The significance of this result is that we provide an efficient dynamic programming-based algorithm for optimal control of CVaR without lifting the state-space. To broaden the applicability of the proposed algorithm, we propose convergent approximation schemes in cases where our key assumptions do not hold and characterize relevant suboptimality bounds. In addition, we extend our method to a more general class of risk metrics, which includes mean-variance and median-deviation. We also demonstrate a concrete application to portfolio optimization under CVaR constraints. Our results contribute an efficient framework for solving time-inconsistent CVaR-based sequential optimization.
Recommendations
- scientific article; zbMATH DE number 1414110
- Optimal control of the risk process in a regime-switching environment
- scientific article; zbMATH DE number 48691
- Optimal risk control under functionally restricted perturbation
- Stochastic optimal control of risk processes with Lipschitz payoff functions
- Conditional value-at-risk: optimization approach
- scientific article; zbMATH DE number 1537583
- Stochastic control of optimized certainty equivalents
- Continuous-time optimal portfolio under a value-at-risk constraint
Cites work
- scientific article; zbMATH DE number 4205918 (Why is no real title available?)
- scientific article; zbMATH DE number 1140123 (Why is no real title available?)
- scientific article; zbMATH DE number 2107836 (Why is no real title available?)
- scientific article; zbMATH DE number 818071 (Why is no real title available?)
- scientific article; zbMATH DE number 5060482 (Why is no real title available?)
- A convex analytic approach to risk-aware Markov decision processes
- An adaptive sparse grid semi-Lagrangian scheme for first order Hamilton-Jacobi Bellman equations
- An introduction to stochastic differential equations
- An introduction to viscosity solutions for fully nonlinear PDE with applications to calculus of variations in L^
- Coherent measures of risk
- Coherent multiperiod risk adjusted values and Bellman's principle
- Conditional value at risk and related linear programming models for portfolio optimization
- Controlled Markov processes and viscosity solutions
- Convex Analysis
- Convex Control Systems and Convex Optimal Control Problems With Constraints
- Convexity of the cost functional in an optimal control problem for a class of positive switched systems
- DYNAMIC INDIFFERENCE VALUATION VIA CONVEX RISK MEASURES
- Distribution-constrained optimal stopping
- Dynamic approaches for some time-inconsistent optimization problems
- Dynamic coherent risk measures
- Dynamic monetary risk measures for bounded discrete-time processes
- Elliptic and parabolic equations with measurable coefficients in weighted Sobolev spaces
- Elliptic partial differential equations of second order
- From stochastic dominance to mean-risk models: Semideviations as risk measures
- Markov decision processes with average-value-at-risk criteria
- Minimum average value-at-risk for finite horizon semi-Markov decision processes in continuous time
- Multi-grid methods for Hamilton-Jacobi-Bellman equations
- Nonlinear PDE approach to time-inconsistent optimal stopping
- Nonuniqueness for Second-Order Elliptic Equations with Measurable Coefficients
- On the Hamilton-Jacobi-Bellman equations
- On the solution of nonlinear hyperbolic differential equations by finite differences
- On weak uniqueness for some diffusions with discontinuous coefficients
- Optimal control of a multistate failure-prone manufacturing system under a conditional value-at-risk cost criterion
- Optimal mean-variance portfolio selection
- Optimal stochastic control, stochastic target problems, and backward SDE.
- Optimization of Convex Risk Functions
- Parabolic and Elliptic Equations with VMO Coefficients
- Parabolic equations with measurable coefficients. II.
- RISK MEASURES AND CAPITAL REQUIREMENTS FOR PROCESSES
- Risk-Sensitive Control on an Infinite Time Horizon
- Risk-averse control of undiscounted transient Markov models
- Risk-averse dynamic programming for Markov decision processes
- Risk-sensitive control and dynamic games for partially observed discrete-time nonlinear systems
- Second order elliptic equations in \(\mathbb{R}^{d}\) with piecewise continuous coefficients
- Semiconcave functions, Hamilton-Jacobi equations, and optimal control
- Strong maximum principle for semicontinuous viscosity solutions of nonlinear partial differential equations
- Theory of constant proportion portfolio insurance
- Time-inconsistent multistage stochastic programs: martingale bounds
- Time-inconsistent portfolio investment problems
- Uniqeness results for fully nonlinear degenerate elliptic equations with discontinuous coefficients
- Variance-Constrained Risk Sharing in Stochastic Systems
Cited in
(22)- Management of portfolio depletion risk through optimal life cycle asset allocation
- Multiperiod mean conditional value at risk asset allocation: is it advantageous to be time consistent?
- Optimality conditions in variational form for non-linear constrained stochastic control problems
- Risk-Aware Linear Quadratic Control Using Conditional Value-at-Risk
- Nonconcave Optimal Investment with Value-at-Risk Constraint: An Application to Life Insurance Contracts
- Optimal control and zero-sum game subject to differential equations with Liu processes and random matrices
- Zero-sum stochastic games with the average-value-at-risk criterion
- Policy gradients for CVaR-constrained MDPs
- Robust optimal control using conditional risk mappings in infinite horizon
- Optimal risk control under functionally restricted perturbation
- The surprising robustness of dynamic mean-variance portfolio optimization to model misspecification errors
- Risk-adaptive approaches to stochastic optimization: a survey
- On the distribution of terminal wealth under dynamic mean-variance optimal investment strategies
- Nested sampling for uncertainty quantification and rare event estimation
- A stochastic primal-dual method for optimization with conditional value at risk constraints
- Risk-theoretic optimal design of output-feedback controllers via iterative convex relaxations
- Continuous-time portfolio optimization for absolute return funds
- Stochastic control of optimized certainty equivalents
- On the dynamic representation of some time-inconsistent risk measures in a Brownian filtration
- Risk-averse autonomous systems: a brief history and recent developments from the perspective of optimal control
- A gradient descent-ascent method for continuous-time risk-averse optimal control
- A Global-in-Time Neural Network Approach to Dynamic Portfolio Optimization
This page was built for publication: Optimal Control of Conditional Value-at-Risk in Continuous Time
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5347544)
