Some New Results on Sample Path Optimality in Ergodic Control of Diffusions

DOI10.1109/TAC.2017.2664342zbMATH Open1390.93859DBLPjournals/tac/Arapostathis17arXiv1605.03989OpenAlexW2372171849WikidataQ60167464 ScholiaQ60167464MaRDI QIDQ4566873FDOQ4566873

Authors: Ari Arapostathis 

Publication date: 27 June 2018

Published in: IEEE Transactions on Automatic Control (Search for Journal in Brave)

Abstract: We present some new results on sample path optimality for the ergodic control problem of a class of non-degenerate diffusions controlled through the drift. The hypothesis most often used in the literature to ensure the existence of an a.s. sample path optimal stationary Markov control requires finite second moments of the first hitting times $au$ of bounded domains over all admissible controls. We show that this can be considerably weakened: $mathrmE[a{u}^2]$ may be replaced with $mathrmE[aul{n}^{+}(au)]$, thus reducing the required rate of convergence of averages from polynomial to logarithmic. A Foster-Lyapunov condition which guarantees this is also exhibited. Moreover, we study a large class of models that are neither uniformly stable, nor have a near-monotone running cost, and we exhibit sufficient conditions for the existence of a sample path optimal stationary Markov control.

Full work available at URL: https://arxiv.org/abs/1605.03989

Recommendations

• scientific article; zbMATH DE number 1254182
• scientific article; zbMATH DE number 3877055
• Optimal ergodic control of Markov diffusion processes with minimum variance
• The optimal control of diffusions
• scientific article; zbMATH DE number 4023182
• scientific article; zbMATH DE number 4183323
• An Ergodic Control Problem for Constrained Diffusion Processes: Existence of Optimal Markov Control

Mathematics Subject Classification ID

Diffusion processes (60J60) Optimal stochastic control (93E20)

Cited In (3)

• Economic design of memory-type control charts: the fallacy of the formula proposed by Lorenzen and Vance (1986)
• Ergodic control of diffusions with compound Poisson jumps under a general structural hypothesis
• Convex analytic method revisited: further optimality results and performance of deterministic policies in average cost stochastic control

This page was built for publication: Some New Results on Sample Path Optimality in Ergodic Control of Diffusions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4566873)