On the Bellman equation for some unbounded control problems
Optimal control problems with unbounded components lead to Bellman equations which frequently do not satisfy the growth conditions which guarantee uniqueness of viscosity solutions. In addition, problems with unbounded components may not even have a continuous value function. This paper tries to address this problem for control problems which include the linear quadratic problem, which had fallen through the cracks of the uniqueness theory. The basic assumption on the dynamics for \(y'=f(y,\alpha)\) is that \[ (f(x,a)-f(y,a))\cdot(x-y) \leq L| x-y| ^2 \] and the controls \(\alpha\) take values in some closed set \(A\), possibly unbounded. The cost function is \(J(x,t,\alpha)=\int_0^t h(y,\alpha)e^{-\lambda s} ds + e^{-\lambda t}g(y_x(t))\). The functions \(h\) and \(g\) are assumed continuous and bounded from below. The value function \(V(x,t)=\inf_{\alpha}J(x,t,\alpha)\) is the object of study and the authors determine general conditions under which \(V\) is continuous, and can be characterized as the unique solution of the Bellman equation.
- On the Bellman equation for infinite horizon problems with unbounded cost functional
- An approach of deterministic control problems with unbounded data
- On the Bellman equations with varying control
- Uniqueness Results for Second-Order Bellman--Isaacs Equations under Quadratic Growth Assumptions and Applications
- Uniqueness of the solution of Bellman's equation in the case of general controlled processes
- On the finite horizon Bellman equation for controlled Markov jump models with unbounded characteristics: Existence and approximation
- Robust/\(H_{\infty}\) filtering for nonlinear systems
- A uniqueness result for the Isaacs equation corresponding to nonlinear \(H_\infty\) control
- On unbounded solutions of Bellman's equation associated with optimal switching control problems with state constraints
- Optimality principles and uniqueness for Bellman equations of unbounded control problems with discontinuous running cost
- On the Bellman equation for infinite horizon problems with unbounded cost functional
- Robust filtering and propagation of uncertainty in hidden Markov models
- On the asymptotic nature of first order mean field games
- Finite mean field games: fictitious play and convergence to a first order continuous mean field game
- Further results on the bellman equation for optimal control problems with exit times and nonnegative lagrangians
- Asymptotic problems in optimal control with a vanishing Lagrangian and unbounded data
- An approach of deterministic control problems with unbounded data
- Pathwise stochastic control with applications to robust filtering
- A dynamic programming approach for controlled fractional SIS models
- Neural network architectures using min-plus algebra for solving certain high-dimensional optimal control problems and Hamilton-Jacobi PDEs
- A Bellman approach for two-domains optimal control problems in \(\mathbb{R}^N\)
- The principle of least action and fundamental solutions of mass-spring and N-body two-point boundary value problems
- The Bellman equation for minimizing the maximum cost
- scientific article; zbMATH DE number 417297 (Why is no real title available?)
- scientific article; zbMATH DE number 4191494 (Why is no real title available?)
- On the uniqueness of a solution to the Bellman equation in Sobolev's classes
- Uniqueness Results for Second-Order Bellman--Isaacs Equations under Quadratic Growth Assumptions and Applications
- A seminumeric approach for solution of the eikonal partial differential equation and its applications
- On Bellman's equations for mean and variance control of a Markov diffusion
- scientific article; zbMATH DE number 4019854 (Why is no real title available?)
- scientific article; zbMATH DE number 55826 (Why is no real title available?)
- The use of a Legendre pseudospectral viscosity technique to solve a class of nonlinear dynamic Hamilton-Jacobi equations
- Optimal control with random parameters: a multiscale approach
- Viscosity Solutions of the Bellman Equation for Exit Time Optimal Control Problems with Non-Lipschitz Dynamics
- On the Bellman equations with varying control
- On the equivalence of the integral and differential Bellman equations in impulse control problems
- Approximating optimal feedback controllers of finite horizon control problems using hierarchical tensor formats
- Parameter uncertainty in the Kalman-Bucy filter
- Convex Hamilton-Jacobi equations under superlinear growth conditions on data
- Comparison and existence results for evolutive non-coercive first-order Hamilton-Jacobi equations
- Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case
- The Chebyshev spectral viscosity method for the time dependent eikonal equation
- A boundary-only meshless method for numerical solution of the eikonal equation
- Regular and exploratory resource extraction models considering sustainability
This page was built for publication: On the Bellman equation for some unbounded control problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1376807)