Characterizations of overtaking optimality for controlled diffusion processes

DOI10.1007/s00245-007-9025-6zbMath1162.49025OpenAlexW1986747074MaRDI QIDQ1021252

Héctor Jasso-Fuentes, Onésimo Hernández-Lerma

Publication date: 8 June 2009

Published in: Applied Mathematics and Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s00245-007-9025-6

zbMATH Keywords

controlled diffusionsbias optimalityovertaking optimalityaverage reward (a.k.a. ergodic reward)

Mathematics Subject Classification ID

Optimal stochastic control (93E20) Existence of optimal solutions to problems involving randomness (49J55)

Related Items

Solving infinite-horizon optimal control problems of the time-delayed systems by Haar wavelet collocation method ⋮ Discrete Time Optimal Control Problems on Large Intervals ⋮ Controlled Switching Diffusions Under Ambiguity: The Average Criterion ⋮ Structure of approximate solutions of dynamic continuous time zero-sum games ⋮ Blackwell Optimality for Controlled Diffusion Processes ⋮ Blackwell-Nash Equilibria in Zero-Sum Stochastic Differential Games ⋮ Bias and Overtaking Optimality for Continuous-Time Jump Markov Decision Processes in Polish Spaces ⋮ One-dimensional infinite horizon nonconcave optimal control problems arising in economic dynamics ⋮ Bias and overtaking equilibria for zero-sum stochastic differential games ⋮ Turnpike properties of approximate solutions of dynamic discrete time zero-sum games ⋮ Stability of a turnpike phenomenon for approximate solutions of nonautonomous discrete-time optimal control systems ⋮ Constrained stochastic differential games with additive structure: average and discount payoffs ⋮ Structure of solutions of discrete time optimal control problems in the regions close to the endpoints ⋮ Policy iteration algorithms for zero-sum stochastic differential games with long-run average payoff criteria ⋮ Structure of approximate solutions of discrete time optimal control Bolza problems on large intervals ⋮ Optimal ergodic control of Markov diffusion processes with minimum variance ⋮ Existence of solutions for a class of nonconcave infinite horizon optimal control problems ⋮ On a class of infinite horizon optimal control problems ⋮ Convergence of solutions of optimal control problems with discounting on large intervals in the regions close to the endpoints ⋮ Stability of a turnpike phenomenon for a discrete-time optimal control system ⋮ Structure of approximate solutions for discrete-time control systems arising in economic dynamics ⋮ The Lagrange and the vanishing discount techniques to controlled diffusions with cost constraints ⋮ Adaptive control of diffusion processes with a discounted reward criterion ⋮ The Lagrange approach to ergodic control of diffusions with cost constraints ⋮ Turnpike results for a class of discrete-time optimal control problems arising in economic dynamics ⋮ An iterative method for suboptimal control of a class of nonlinear time-delayed systems ⋮ Discounted robust control for Markov diffusion processes ⋮ Structure of solutions of variational problems with extended-valued integrands in the regions close to the endpoints ⋮ On the use of stochastic differential games against nature to ergodic control problems with unknown parameters ⋮ Overtaking optimality for controlled Markov-modulated diffusions ⋮ Nonzero-sum stochastic differential games with additive structure and average payoffs ⋮ Discount-sensitive equilibria in zero-sum stochastic differential games

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Subgeometric ergodicity of strong Markov processes
• Ergodic control of multidimensional diffusions. II: Adaptive control
• Markov chains and stochastic stability
• On the Bellman equation of the overtaking criterion
• Optimal controls for diffusion in \(R^ d\)- a min-max max-min formula for the minimal cost growth rate
• Controlled diffusion processes on infinite horizon with the overtaking criterion
• On overtaking optimal tracking for linear systems
• A counterexample on overtaking optimality
• Dynamic programming in economics.
• Continuous-time controlled Markov chains with discounted rewards
• On the Poisson equation and diffusion approximation. I
• A Liapounov bound for solutions of the Poisson equation
• Turnpike properties in the calculus of variations and optimal control
• Bias and overtaking equilibria for zero-sum continuous-time Markov games
• Ergodic Control of Diffusion Processes
• Optimal Control of Switching Diffusions with Application to Flexible Manufacturing Systems
• Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
• Bias Optimality for Continuous-Time Controlled Markov Chains
• The Recurrence Structure of General Markov Processes
• Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
• Optimal Plans for Dynamic Programming Problems
• Ergodic Control of Switching Diffusions
• Nonlinear overtaking optimal control: sufficiency, stability, and approximation
• Average cost Markov control processes with weighted norms: existence of canonical policies
• Average Optimality in Markov Control Processes via Discounted-Cost Problems and Linear Programming
• Stochastic Calculus
• On the Poisson equation for singular diffusions
• On Subexponential Mixing Rate for Markov Processes

This page was built for publication: Characterizations of overtaking optimality for controlled diffusion processes