On discounted dynamic programming with unbounded returns (Q2431099)

From MaRDI portal





scientific article; zbMATH DE number 5876947
Language Label Description Also known as
default for all languages
No label defined
    English
    On discounted dynamic programming with unbounded returns
    scientific article; zbMATH DE number 5876947

      Statements

      On discounted dynamic programming with unbounded returns (English)
      0 references
      8 April 2011
      0 references
      The paper starts with a very good survey of the literature on Markov decision processes and related problems. The authors apply the idea of k-local contraction of \textit{J. P. Rincón-Zapatero} and \textit{C. Rodriguez-Palmero} [Econometrica 71, No. 5, 1519--1555 (2003; Zbl 1154.49303); Econ. Theory 33, No. 2, 381--391 (2007; Zbl 1180.91128)] to study discounted stochastic programming models with unbounded returns. The main results concern the existence of a unique solution to the Bellman equation that are applied to the theory of stochastic optimal growth. Also a discussion of some subtle issues concerning k-local and global contractions is included.
      0 references
      stochastic dynamic programming
      0 references
      Bellman functional equation
      0 references
      contraction mapping
      0 references
      stochastic optimal growth
      0 references
      0 references
      0 references

      Identifiers

      0 references
      0 references
      0 references
      0 references
      0 references
      0 references