Linear Programming Approach to Deterministic Infinite Horizon Optimal Control Problems with Discounting
From MaRDI portal
Publication:3581031
DOI10.1137/070696209zbMath1201.49040OpenAlexW2076038142MaRDI QIDQ3581031
Marc Quincampoix, Vladimir Gaitsgory
Publication date: 16 August 2010
Published in: SIAM Journal on Control and Optimization (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1137/070696209
linear programmingdualitynumerical solutionaveragingoccupational measuresviability kernelslong run average optimal controloptimal control problems with discounting
Linear programming (90C05) Duality theory (optimization) (49N15) Optimality conditions for problems involving ordinary differential equations (49K15)
Related Items
A partial history of the early development of continuous-time nonlinear stochastic systems theory ⋮ Unnamed Item ⋮ Linear programming based optimality conditions and approximate solution of a deterministic infinite horizon discounted optimal control problem in discrete time ⋮ Linear Conic Optimization for Inverse Optimal Control ⋮ The problem of optimal control with reflection studied through a linear optimization problem stated on occupational measures ⋮ Characterization of the optimal trajectories for the averaged dynamics associated to singularly perturbed control systems ⋮ SIR epidemics with state-dependent costs and ICU constraints: a Hamilton-Jacobi verification argument and dual LP algorithms ⋮ Linearization techniques for controlled piecewise deterministic Markov processes; application to Zubov's method ⋮ LP-related representations of Cesàro and Abel limits of optimal value functions ⋮ Aggregated occupation measures and linear programming approach to constrained impulse control problems ⋮ Linear programming formulations of deterministic infinite horizon optimal control problems in discrete time ⋮ Linear programming estimates for Cesàro and Abel limits of optimal values in optimal control problems ⋮ On sets of occupational measures generated by a deterministic control system on an infinite time horizon ⋮ On Near Optimal Control of Systems with Slow Observables ⋮ Use of Approximations of Hamilton-Jacobi-Bellman Inequality for Solving Periodic Optimization Problems ⋮ Some applications of linear programming formulations in stochastic control ⋮ Linear programming formulation of long-run average optimal control problem ⋮ Compactification method in linear programming approach to infinite-horizon optimal control problems with a noncompact state constraint ⋮ A linear programming approach to approximating the infinite time reachable set of strictly stable linear control systems ⋮ A qualitative game of interest rate adjustments with a nuisance agent ⋮ Stabilization with discounted optimal control ⋮ A survey of average cost problems in deterministic discrete-time control systems ⋮ Semi-definite relaxations for optimal control problems with oscillation and concentration effects ⋮ Discontinuous control problems with state constraints: linear formulations and dynamic programming principles ⋮ Computation of viability kernels: a case study of by-catch fisheries ⋮ Turnpike properties of approximate solutions of dynamic discrete time zero-sum games ⋮ Representation Formulas for Limit Values of Long Run Stochastic Optimal Controls ⋮ Computable Primal and Dual Bounds for Stochastic Control ⋮ Optimal control problems with oscillations, concentrations and discontinuities ⋮ On representation formulas for long run averaging optimal control problem ⋮ Infection time in multistable gene networks. A backward stochastic variational inequality with nonconvex switch-dependent reflection approach ⋮ Occupational measures and averaged shape optimization ⋮ Linear programming approach to optimal impulse control problems with functional constraints ⋮ Mayer and optimal stopping stochastic control problems with discontinuous cost ⋮ Stochastic optimal control and linear programming approach ⋮ On average control generating families for singularly perturbed optimal control problems with long run average optimality criteria ⋮ Convex computation of extremal invariant measures of nonlinear dynamical systems and Markov processes ⋮ Existence of asymptotic values for nonexpansive stochastic control systems ⋮ Min–max control problems via occupational measures ⋮ LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case ⋮ Vanishing Discount Limit and Nonexpansive Optimal Control and Differential Games ⋮ Turnpike theorem for terminal functionals in infinite horizon optimal control problems ⋮ Averaging and linear programming in some singularly perturbed problems of optimal control ⋮ Optimality issues for a class of controlled singularly perturbed stochastic systems ⋮ Controller design and value function approximation for nonlinear dynamical systems