Dynamic approaches for some time-inconsistent optimization problems
From MaRDI portal
comparison principledualitydynamic programming principledynamic utilitymaster equationpath derivativestochastic maximum principletime inconsistency
PDEs on infinite-dimensional (e.g., function) spaces (= PDEs in infinitely many variables) (35R15) Optimality conditions for problems involving randomness (49K45) Dynamic programming in optimal control and differential games (49L20) Duality theory (optimization) (49N15) Stochastic ordinary differential equations (aspects of stochastic analysis) (60H10) Social and behavioral sciences: general topics (91C99) Financial applications of other theories (91G80) Optimal stochastic control (93E20)
Abstract: In this paper we investigate possible approaches to study general time-inconsistent optimization problems without assuming the existence of optimal strategy. This leads immediately to the need to refine the concept of time-consistency as well as any method that is based on Pontryagin's Maximum Principle. The fundamental obstacle is the dilemma of having to invoke the {it Dynamic Programming Principle} (DPP) in a time-inconsistent setting, which is contradictory in nature. The main contribution of this work is the introduction of the idea of the "dynamic utility" under which the original time inconsistent problem (under the fixed utility) becomes a time consistent one. As a benchmark model, we shall consider a stochastic controlled problem with multidimensional backward SDE dynamics, which covers many existing time-inconsistent problems in the literature as special cases, and we argue that the time inconsistency is essentially equivalent to the lack of {it comparison principle}. We shall propose three approaches aiming at reviving the DPP in this setting: the duality approach, the dynamic utility approach, and the master equation approach. Unlike the game approach in many existing works in continuous time models, all our approaches produce the same value as the original static problem.
Recommendations
- Time-inconsistent optimal control problems
- A theory of Markovian time-inconsistent stochastic control in discrete time
- Deterministic time-inconsistent optimal control problems -- an essentially cooperative approach
- Time-inconsistent optimal control problems and related issues
- Time-inconsistent optimal control problems and the equilibrium HJB equation
Cites work
- A theory of Markovian time-inconsistent stochastic control in discrete time
- Advances in prospect theory: cumulative representation of uncertainty
- An exact connection between two solvable SDEs and a nonlinear utility stochastic PDE
- Better than dynamic mean-variance: time inconsistency and free cash flow stream
- Contract theory in continuous-time models
- Dynamic programming for stochastic target problems and geometric flows
- Functional Itô calculus
- Functional Itō calculus and stochastic integral representation of martingales
- scientific article; zbMATH DE number 5499205 (Why is no real title available?)
- Mathematicalising behavioural finance
- Mean-variance portfolio optimization with state-dependent risk aversion
- Multi-portfolio time consistency for set-valued convex and coherent risk measures
- Nonlinear PDE approach to time-inconsistent optimal stopping
- On the comparison theorem for multidimensional BSDEs
- On the convergence of monotone schemes for path-dependent PDEs
- On viscosity solutions of path dependent PDEs
- Optimal stopping under probability distortion
- Pathwise Itô calculus for rough paths and rough PDEs with path dependent coefficients
- Prospect Theory: An Analysis of Decision under Risk
- Pseudo-Markovian viscosity solutions of fully nonlinear degenerate PPDEs
- Set-valued analysis
- Solvability of forward-backward SDEs and the nodal set of Hamilton- Jacobi-Bellman equations
- Stochastic Partial Differential Equations and Portfolio Choice
- Stochastic target problems with controlled loss
- The golden rule when preferences are time inconsistent
- The Master Equation and the Convergence Problem in Mean Field Games
- Time consistency of dynamic risk measures in markets with transaction costs
- Time-inconsistent optimal control problems and the equilibrium HJB equation
- Time-inconsistent stochastic linear-quadratic control
- Viscosity solutions of fully nonlinear parabolic path dependent PDEs. I.
- Viscosity solutions of fully nonlinear parabolic path dependent PDEs. II
Cited in
(31)- Robust time-inconsistent stochastic control problems
- Dynamic consistency for stochastic optimal control problems
- Set-valued risk measures as backward stochastic difference inclusions and equations
- Time consistency for scalar multivariate risk measures
- Acceptability maximization
- On the dynamic representation of some time-inconsistent risk measures in a Brownian filtration
- Discrete-time mean-CVaR portfolio selection and time-consistency induced term structure of the CVaR
- Conditional optimal stopping: a time-inconsistent optimization
- Nonlinear PDE approach to time-inconsistent optimal stopping
- A note on an intertemporal cost function for a class of dynamic problems
- Time-consistent conditional expectation under probability distortion
- Time-inconsistent Markovian control problems under model uncertainty with application to the mean-variance portfolio selection
- Multi-time state mean-variance model in continuous time
- Time consistency of the mean-risk problem
- Who are I: time inconsistency and intrapersonal conflict and reconciliation
- Tail optimality and preferences consistency for intertemporal optimization problems
- Mean-variance portfolio selection with dynamic targets for expected terminal wealth
- Dynamic set values for nonzero-sum games with multiple equilibriums
- Scalar multivariate risk measures with a single eligible asset
- Stochastic control of optimized certainty equivalents
- Equilibrium strategies for time-inconsistent stochastic switching systems
- On time consistency for mean-variance portfolio selection
- Portfolio choice with skewness preference and wealth-dependent risk aversion
- Optimal Control of Conditional Value-at-Risk in Continuous Time
- Forward rank‐dependent performance criteria: Time‐consistent investment under probability distortion
- Short Communication: Is a Sophisticated Agent Always a Wise One?
- Me, myself and I: a general theory of non-Markovian time-inconsistent stochastic control for sophisticated agents
- Short communication: on the separability of vector-valued risk measures
- Inference of utilities and time preference in sequential decision-making
- Backward stochastic control system with entropy regularization
- Time-inconsistent stochastic optimal control problems: a backward stochastic partial differential equations approach
This page was built for publication: Dynamic approaches for some time-inconsistent optimization problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1704140)
