On discounted dynamic programming with unbounded returns (Q2431099)

From MaRDI portal
scientific article
Language Label Description Also known as
English
On discounted dynamic programming with unbounded returns
scientific article

    Statements

    On discounted dynamic programming with unbounded returns (English)
    0 references
    8 April 2011
    0 references
    The paper starts with a very good survey of the literature on Markov decision processes and related problems. The authors apply the idea of k-local contraction of \textit{J. P. Rincón-Zapatero} and \textit{C. Rodriguez-Palmero} [Econometrica 71, No. 5, 1519--1555 (2003; Zbl 1154.49303); Econ. Theory 33, No. 2, 381--391 (2007; Zbl 1180.91128)] to study discounted stochastic programming models with unbounded returns. The main results concern the existence of a unique solution to the Bellman equation that are applied to the theory of stochastic optimal growth. Also a discussion of some subtle issues concerning k-local and global contractions is included.
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    stochastic dynamic programming
    0 references
    Bellman functional equation
    0 references
    contraction mapping
    0 references
    stochastic optimal growth
    0 references
    0 references
    0 references
    0 references