Almost sure optimality and optimality in probability for stochastic control problems over an infinite time horizon
A pathwise optimality criterion for stochastic control problems is proposed, which is aimed at reducing the risk connected with the fluctuation of cost: Consider \[ dx^u_t= f(x^u_t,u_t)d \tau+\sigma (x^u_t,u_t) dw_t, \] with cost function \[ J_T(u)= \int^T_0 c(x_t^u,u_t) dt, \] and look for a control \(u^*\) optimal in the sense that \[ \lim_{T\to \infty}g_T \bigl[J_T (u^*)-J_T(u) \bigr]^+ =0\text{ a.s. for any }u\in {\mathcal U_\infty}, \] with \(g\) positive, non-increasing, typically \(o(1/t)\). This may be of interest, e.g., in economical applications, when risky situations are particularly dangerous. The control problem is solved under a number of technical conditions, and two examples are discussed, in particular the linear Gaussian model with quadratic cost function.
- On asymptotic optimality in probability and almost surely in dynamic control
- Infinite horizon optimal control problem for stochastic evolution equations in Hilbert spaces
- On almost sure optimization for stochastic control systems
- Stochastic linear quadratic optimal control problems in infinite horizon
- On the infinite time solution to state-constrained stochastic optimal control problems
- Stochastic control of optimized certainty equivalents
- The linear-quadratic stochastic optimal control problem with random horizon at the finite number of infinitesimal events
- Necessary conditions for stochastic optimal control problems in infinite dimensions
- Stochastic variational formula for fundamental solutions of parabolic PDE
- Pathwise optimality in stochastic control
- Sample-Path Optimal Stationary Policies in Stable Markov Decision Chains with the Average Reward Criterion
- Optimality in probability and almost surely. the general scheme and a linear regulator problem
- The optimum stochastic control for a problem with random cost incursion times
- Оптимальность почти наверное и по вероятности для стохастического линейно-квадратического регулятора
- Large time asymptotic problems for optimal stochastic control with superlinear cost
- scientific article; zbMATH DE number 219315 (Why is no real title available?)
- scientific article; zbMATH DE number 1865424 (Why is no real title available?)
- Almost sure optimality and optimality in probability for stochastic linear-quadratic regulator with partial information
This page was built for publication: Almost sure optimality and optimality in probability for stochastic control problems over an infinite time horizon
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1808209)