Average cost Markov control processes: Stability with respect to the Kantorovich metric (Q836860): Difference between revisions

From MaRDI portal
Importer (talk | contribs)
Created a new Item
 
ReferenceBot (talk | contribs)
Changed an Item
 
(5 intermediate revisions by 4 users not shown)
Property / author
 
Property / author: Evgueni I. Gordienko / rank
Normal rank
 
Property / author
 
Property / author: Raúl Montes-De-oca / rank
Normal rank
 
Property / reviewed by
 
Property / reviewed by: Pavel V. Gapeev / rank
Normal rank
 
Property / author
 
Property / author: Evgueni I. Gordienko / rank
 
Normal rank
Property / author
 
Property / author: Raúl Montes-De-oca / rank
 
Normal rank
Property / reviewed by
 
Property / reviewed by: Pavel V. Gapeev / rank
 
Normal rank
Property / MaRDI profile type
 
Property / MaRDI profile type: MaRDI publication profile / rank
 
Normal rank
Property / full work available at URL
 
Property / full work available at URL: https://doi.org/10.1007/s00186-008-0229-6 / rank
 
Normal rank
Property / OpenAlex ID
 
Property / OpenAlex ID: W2002222423 / rank
 
Normal rank
Property / cites work
 
Property / cites work: An estimate of the stability of optimal control of certain stochastic and deterministic systems / rank
 
Normal rank
Property / cites work
 
Property / cites work: Average cost Markov control processes with weighted norms: existence of canonical policies / rank
 
Normal rank
Property / cites work
 
Property / cites work: Discounted cost optimality problem: Stability with respect to weak metrics / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q5389642 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Stability estimates in the problem of average optimal switching of a Markov chain / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q5389855 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Perturbation theory for unbounded Markov reward processes with applications to queueing / rank
 
Normal rank
Property / cites work
 
Property / cites work: Error bounds for nonnegative dynamic models / rank
 
Normal rank
Property / cites work
 
Property / cites work: The average cost optimality equation: a fixed point approach / rank
 
Normal rank
links / mardi / namelinks / mardi / name
 

Latest revision as of 22:29, 1 July 2024

scientific article
Language Label Description Also known as
English
Average cost Markov control processes: Stability with respect to the Kantorovich metric
scientific article

    Statements

    Average cost Markov control processes: Stability with respect to the Kantorovich metric (English)
    0 references
    9 September 2009
    0 references
    Perturbations of a discrete-time Markov control process are studied on a general state space. The amount of perturbation is measured by means of the Kantorovich distance. It is assumed that an average (per unit of time on the infinite horizon) optimal control policy can be found for the perturbed (supposedly known) process, and that it is used to control the original (unperturbed) process. The one-stage cost is not assumed to be bounded. Under Lyapunov-like conditions, the authors find upper bounds for the average cost excess when such an approximation is used in place of the optimal (unknown) control policy. As an application of the inequalities found, the approximation by relevant empirical distributions are considered. The results are illustrated by estimating the stability of a simple autoregressive control process. Some examples of unstable processes are also provided.
    0 references
    discrete-time Markov control process
    0 references
    average cost
    0 references
    contraction
    0 references
    stability inequality
    0 references
    Kantorovich metric
    0 references

    Identifiers

    0 references
    0 references
    0 references
    0 references
    0 references
    0 references