Ergodic Control of Diffusion Processes

DOI10.1017/CBO9781139003605zbMath1236.93137OpenAlexW1583562272WikidataQ60167498 ScholiaQ60167498MaRDI QIDQ3105813

Vivek S. Borkar, Mrinal K. Ghosh, Aristotle Arapostathis

Publication date: 19 December 2011

Full work available at URL: https://doi.org/10.1017/cbo9781139003605

Mathematics Subject Classification ID

Research exposition (monographs, survey articles) pertaining to systems and control theory (93-02) Diffusion processes (60J60) Stochastic systems in control theory (general) (93E03) Ergodic theory (37A99) Measure-theoretic ergodic theory (28D99)

Related Items

Impulse Control Maximizing Average Cost per Unit Time: A Nonuniformly Ergodic Case ⋮ Analytical and numerical solutions to ergodic control problems arising in environmental management ⋮ Existence-Uniqueness for Nonlinear Integro-differential Equations with Drift in \({\boldsymbol{\mathbb{R}}^{{\textrm{d}}}}\) ⋮ Nonzero-sum risk-sensitive stochastic differential games: a multi-parameter eigenvalue problem approach ⋮ Exponential stability of stochastic functional differential equations with impulsive perturbations and Markovian switching ⋮ Fokker-Planck-Kolmogorov equations with a parameter ⋮ Continuity of cost in Borkar control topology and implications on discrete space and time approximations for controlled diffusions under several criteria ⋮ A Viscous Ergodic Problem with Unbounded and Measurable Ingredients, Part 1: HJB Equation ⋮ Ergodic control of McKean-Vlasov SDEs and associated Bellman equation ⋮ Blackwell-Nash Equilibria in Zero-Sum Stochastic Differential Games ⋮ Continuous‐time stochastic gradient descent for optimizing over the stationary distribution of stochastic differential equations ⋮ Singular ergodic control for multidimensional Gaussian–Poisson processes ⋮ Optimal ergodic control of Markov diffusion processes with minimum variance ⋮ The Lagrange and the vanishing discount techniques to controlled diffusions with cost constraints ⋮ Zero-sum risk-sensitive stochastic differential games with reflecting diffusions in the orthant ⋮ A Variational Characterization of the Risk-Sensitive Average Reward for Controlled Diffusions on $\mathbb{R}^d$ ⋮ Ergodic risk-sensitive stochastic differential games with reflecting diffusions in a bounded domain ⋮ A nonzero-sum risk-sensitive stochastic differential game in the orthant ⋮ Quadratic Lyapunov function for stochastic mechanical systems with switching impacts ⋮ Infinite horizon controlled diffusions with randomly varying and state-dependent discount cost rates ⋮ Optimal inventory control with path-dependent cost criteria ⋮ Mean-Field Limit for a Class of Stochastic Ergodic Control Problems ⋮ Stochastic finite-time partial stability, partial-state stabilization, and finite-time optimal feedback control ⋮ Steady states of Fokker-Planck equations. II: Non-existence ⋮ Error bounds for model reduction of feedback-controlled linear stochastic dynamics on Hilbert spaces ⋮ Liouville properties and critical value of fully nonlinear elliptic operators ⋮ Impulsive control for continuous-time Markov decision processes: a linear programming approach ⋮ Optimal sustainable harvesting of populations in random environments ⋮ Controlled Switching Diffusions Under Ambiguity: The Average Criterion ⋮ Optimal Ergodic Harvesting under Ambiguity ⋮ Relative Value Iteration for Stochastic Differential Games ⋮ On Some Quasi-Variational Inequalities and Other Problems with Moving Sets ⋮ Blackwell Optimality for Controlled Diffusion Processes ⋮ Geometry of information structures, strategic measures and associated stochastic control topologies ⋮ Robust maximization of asymptotic growth under covariance uncertainty ⋮ Zero-sum semi-Markov games with a probability criterion ⋮ Jet lag recovery: synchronization of circadian oscillators as a mean field game ⋮ Risk-sensitive control with near monotone cost ⋮ Asymptotic optimal tracking: feedback strategies ⋮ Subexponential upper and lower bounds in Wasserstein distance for Markov processes ⋮ General nonlinear stochastic systems motivated by chemostat models: complete characterization of long-time behavior, optimal controls, and applications to wastewater treatment ⋮ On the global convergence of relative value iteration for infinite-horizon risk-sensitive control of diffusions ⋮ Non-uniqueness of solutions of the Hamilton-Jacobi-Bellman equation for time-average control ⋮ Linear programming formulation of long-run average optimal control problem ⋮ Ergodic control of multi-class \(\mathrm{M}/\mathrm{M}/N+\mathrm{M}\) queues in the Halfin-Whitt regime ⋮ On the monotonicity property of the generalized eigenvalue for weakly-coupled cooperative elliptic systems ⋮ A survey of average cost problems in deterministic discrete-time control systems ⋮ The Dyson and Coulomb games ⋮ Large deviations for multiscale diffusion via weak convergence methods ⋮ Optimal Control of Markov-Modulated Multiclass Many-Server Queues ⋮ An eigenvalue approach to the risk sensitive control problem in near monotone case ⋮ On Iteration Improvement for Averaged Expected Cost Control for One-Dimensional Ergodic Diffusions ⋮ Sequential stochastic control (single or multi-agent) problems nearly admit change of measures with independent measurement ⋮ An ergodic control problem for many-server multiclass queueing systems with cross-trained servers ⋮ Risk-sensitive stochastic differential games with reflecting diffusions ⋮ Ergodic switching control for diffusion-type processes ⋮ Risk-sensitive control of pure jump process on countable space with near monotone cost ⋮ Energy-based feedback control for stochastic port-controlled Hamiltonian systems ⋮ Delay Feedback Control for Switching Diffusion Systems Based on Discrete-Time Observations ⋮ Nonexistence of nonconstant solutions of some degenerate Bellman equations and applications to stochastic control ⋮ On the link between infinite horizon control and quasi-stationary distributions ⋮ On existence of Lyapunov functions for a stationary Kolmogorov equation with a probability solution ⋮ Strict monotonicity of principal eigenvalues of elliptic operators in \(\mathbb R^d\) and risk-sensitive control ⋮ Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis ⋮ Technical Note—On the Optimality of Reflection Control ⋮ Policy iteration algorithms for zero-sum stochastic differential games with long-run average payoff criteria ⋮ Linear PDEs and eigenvalue problems corresponding to ergodic stochastic optimization problems on compact manifolds ⋮ Asymptotic harvesting of populations in random environments ⋮ The ergodic problem for some subelliptic operators with unbounded coefficients ⋮ On solutions of mean field games with ergodic cost ⋮ Analysis of criteria for long-run average in the problem of stochastic linear regulator ⋮ Sustainable harvesting policies under long-run average criteria: near optimality ⋮ Economic design of memory-type control charts: the fallacy of the formula proposed by Lorenzen and Vance (1986) ⋮ Zero-sum stochastic games with partial information and average payoff ⋮ On average control generating families for singularly perturbed optimal control problems with long run average optimality criteria ⋮ Phase transitions arising in stochastic ergodic control associated with viscous Hamilton-Jacobi equations with bounded inward drift ⋮ Continuous-Time Robust Dynamic Programming ⋮ Risk-sensitive ergodic control of reflected diffusion processes in orthant ⋮ Simultaneous small noise limit for singularly perturbed slow-fast coupled diffusions ⋮ A Variational Formula for Risk-Sensitive Control of Diffusions in $\mathbb{R}^d$ ⋮ Ergodic control of diffusions with random intervention times ⋮ Optimal Ergodic Control of Linear Stochastic Differential Equations with Quadratic Cost Functionals Having Indefinite Weights ⋮ Stochastic differential games and inverse optimal control and stopper policies ⋮ Zero-sum stochastic differential games with risk-sensitive cost ⋮ Infinite-Horizon Average Optimality of the N-Network in the Halfin–Whitt Regime ⋮ Adaptive control of diffusion processes with a discounted reward criterion ⋮ Characterizations of overtaking optimality for controlled diffusion processes ⋮ LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case ⋮ Convergence to Periodic Probability Solutions in Fokker--Planck Equations ⋮ Nonzero-sum risk-sensitive stochastic differential games with discounted costs ⋮ The Dirichlet problem for stable-like operators and related probabilistic representations ⋮ On pricing barrier control in a regime-switching regulated market ⋮ Convergence to equilibrium in Fokker-Planck equations ⋮ On the relative value iteration with a risk-sensitive criterion ⋮ A variational characterization of the optimal exit rate for controlled diffusions ⋮ Quasistationary distributions and ergodic control problems ⋮ On uniqueness of solutions to viscous HJB equations with a subquadratic nonlinearity in the gradient ⋮ An adaptive control architecture for leader–follower multiagent systems with stochastic disturbances and sensor and actuator attacks ⋮ Existence of periodic probability solutions to Fokker-Planck equations with applications ⋮ Moment bounds and ergodicity of switching diffusion systems involving two-time-scale Markov chains ⋮ On Uniform Exponential Ergodicity of Markovian Multiclass Many-Server Queues in the Halfin–Whitt Regime ⋮ On the policy improvement algorithm for ergodic risk-sensitive control ⋮ Certain Liouville properties of eigenfunctions of elliptic operators ⋮ The role of systems biology, neuroscience, and thermodynamics in network control and learning ⋮ Uniform stability of some large-scale parallel server networks ⋮ “Controlled” Versions of the Collatz–Wielandt and Donsker–Varadhan Formulae ⋮ Discounted robust control for Markov diffusion processes ⋮ Averaging and linear programming in some singularly perturbed problems of optimal control ⋮ On the use of stochastic differential games against nature to ergodic control problems with unknown parameters ⋮ A Correction to “A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions ⋮ Optimizing Noisy Complex Systems Liable to Failure ⋮ Exponential convergence of multi-dimensional stochastic mechanical systems with switching impacts ⋮ Integral identity and measure estimates for stationary Fokker-Planck equations ⋮ Steady states of Fokker-Planck equations. III: Degenerate diffusion ⋮ Discount-sensitive equilibria in zero-sum stochastic differential games ⋮ Differentiability of solutions of stationary Fokker-Planck-Kolmogorov equations with respect to a parameter ⋮ Stochastic stability of measures in gradient systems

This page was built for publication: Ergodic Control of Diffusion Processes