Long-term average cost control problems for continuous time Markov processes: A survey

DOI10.1007/BF00046603zbMath0531.93068MaRDI QIDQ788690

Maurice Robin

Publication date: 1983

Published in: Acta Applicandae Mathematicae (Search for Journal in Brave)

zbMATH Keywords

impulse controlcontinuous control, stopping problemlong-term average costundiscounted stochastic control Markov processes

Mathematics Subject Classification ID

Continuous-time Markov processes on general state spaces (60J25) Variational inequalities (49J40) Dynamic programming in optimal control and differential games (49L20) Dynamic programming (90C39) Optimal stochastic control (93E20) Stopping times; optimal stopping problems; gambling theory (60G40) Optimality conditions for problems involving randomness (49K45) Optimal stopping in statistics (62L15) Existence of optimal solutions to problems involving randomness (49J55)

Related Items (32)

Optimal inventory control with path-dependent cost criteria ⋮ An optimal stopping time problem with time average cost in a bounded interval ⋮ A partial history of the early development of continuous-time nonlinear stochastic systems theory ⋮ Joint insurance and capitalization costs ⋮ The probabilistic structure of controlled diffusion processes ⋮ Controlled diffusion processes on infinite horizon with the overtaking criterion ⋮ Ergodic problem for optimal stochastic switching ⋮ Long term average cost control problems without ergodicity ⋮ Asymptotic behavior of the first order obstacle problem ⋮ Perturbation methods in optimal stopping with average cost criterion ⋮ On an Approximation of Average Cost per Unit Time Impulse Control of Markov Processes ⋮ Impulse Control Maximizing Average Cost per Unit Time: A Nonuniformly Ergodic Case ⋮ Ergodic switching control for diffusion-type processes ⋮ Optimal controls for diffusion in \(R^ d\)- a min-max max-min formula for the minimal cost growth rate ⋮ Singular ergodic control for multidimensional Gaussian processes ⋮ Economic design of memory-type control charts: the fallacy of the formula proposed by Lorenzen and Vance (1986) ⋮ Optimal control of molecular dynamics using Markov state models ⋮ Time-to-build and capacity choice ⋮ Ergodic control of reflected diffusions with jumps ⋮ Hamilton-Jacobi Equations with State Constraints ⋮ Optimal control of multiscale systems using reduced-order models ⋮ Long-run risk sensitive dyadic impulse control ⋮ Ergodic control of diffusions with random intervention times ⋮ MAXIMIZING THE GROWTH RATE UNDER RISK CONSTRAINTS ⋮ Quelques remarques sur les problèmes elliptiques quasilinéaires du second ordre. (Some remarks on second order quasilinear elliptic problems) ⋮ On almost sure optimization for stochastic control systems ⋮ A note on asymptotics between singular and constrained control problems of one-dimensional diffusions ⋮ Optimal Central Bank intervention in the foreign exchange market ⋮ Ergodic control problem for one-dimensional diffusions with near-monotone cost ⋮ On average cost stopping time problems ⋮ On ergodic impulsive control problems ⋮ Problèmes de Neumann quasilinéaires. (Quasilinear Neumann problems)

Cites Work

• Asymptotics in quasi-variational inequalities and ergodic control problems
• Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion
• On a degenerate variational inequality with Neumann boundary conditions
• Continuous time control of Markov processes on an arbitrary state space: average return criterion
• Optimal control of diffusion processes with reflection
• On the Optimal Stopping Time Problem for Degenerate Diffusions
• On Some Impulse Control Problems with Long Run Average Cost
• Countable-state average-cost regenerative stopping problems
• Optimal control of service in tandem queues
• On Semi-Markov Controlled Models with an Average Reward Criterion
• Temps d'arrÊt optimal, théorie générale des processus et processus de Markov
• Stationary Markovian Decision Problems and Perturbation Theory of Quasi-Compact Linear Operators
• On Optimal Control of a Non-Terminating Diffusion Process with Reflection
• Nondiscounted Continuous Time Markovian Decision Process with Countable State Space
• Discrete Dynamic Programming
• Étude asymptotique des systèmes markoviens à commande
• Average cost semi-markov decision processes
• Diffusion processes with boundary conditions
• Maximal Average-Reward Policies for Semi-Markov Decision Processes With Arbitrary State and Action Space
• On the Nonexistence of $|varepsilon$-Optimal Randomized Stationary Policies in Average Cost Markov Decision Models
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: Long-term average cost control problems for continuous time Markov processes: A survey