On discounted dynamic programming with unbounded returns (Q2431099)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | On discounted dynamic programming with unbounded returns |
scientific article |
Statements
On discounted dynamic programming with unbounded returns (English)
0 references
8 April 2011
0 references
The paper starts with a very good survey of the literature on Markov decision processes and related problems. The authors apply the idea of k-local contraction of \textit{J. P. Rincón-Zapatero} and \textit{C. Rodriguez-Palmero} [Econometrica 71, No. 5, 1519--1555 (2003; Zbl 1154.49303); Econ. Theory 33, No. 2, 381--391 (2007; Zbl 1180.91128)] to study discounted stochastic programming models with unbounded returns. The main results concern the existence of a unique solution to the Bellman equation that are applied to the theory of stochastic optimal growth. Also a discussion of some subtle issues concerning k-local and global contractions is included.
0 references
stochastic dynamic programming
0 references
Bellman functional equation
0 references
contraction mapping
0 references
stochastic optimal growth
0 references