On discounted dynamic programming with unbounded returns

DOI10.1007/s00199-010-0522-5zbMath1219.90182OpenAlexW1984186330MaRDI QIDQ2431099

Janusz Matkowski, Andrzej S. Nowak

Publication date: 8 April 2011

Published in: Economic Theory (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s00199-010-0522-5

zbMATH Keywords

stochastic dynamic programmingcontraction mappingstochastic optimal growthBellman functional equation

Mathematics Subject Classification ID

Dynamic programming in optimal control and differential games (49L20) Economic growth models (91B62) Optimal stochastic control (93E20) Markov and semi-Markov decision processes (90C40)

Related Items

Unbounded dynamic programming via the Q-transform ⋮ Necessity of the terminal condition in the infinite horizon dynamic optimization problems with unbounded payoff ⋮ Optimality of Ramsey-Euler policy in the stochastic growth model ⋮ Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting ⋮ Extinction in common property resource models: an analytically tractable example ⋮ Markov perfect equilibria in OLG models with risk sensitive agents ⋮ An approximation approach to dynamic programming with unbounded returns ⋮ Stochastic optimal growth model with risk sensitive preferences ⋮ On the expected total reward with unbounded returns for Markov decision processes ⋮ Dynamic programming with state-dependent discounting ⋮ Elementary results on solutions to the Bellman equation of dynamic programming: existence, uniqueness, and convergence ⋮ On uniqueness of time-consistent Markov policies for quasi-hyperbolic consumers under uncertainty ⋮ Stochastic games with unbounded payoffs: applications to robust control in economics ⋮ Time consistent Markov policies in dynamic economies with quasi-hyperbolic consumers ⋮ Existence and uniqueness of a stationary and ergodic solution to stochastic recurrence equations via Matkowski’s FPT ⋮ Infinite-horizon deterministic dynamic programming in discrete time: a monotone convergence principle and a penalty method

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Optimal growth models with bounded or unbounded returns: A unifying approach
• Recursive utility and the Ramsey problem
• Universally measurable strategies in zero-sum stochastic games
• Stochastic optimal control. The discrete time case
• Markovian equilibrium in a class of stochastic games: Existence theorems for discounted and undiscounted models
• Discounting long run average growth in stochastic dynamic programs
• Recursive utility with unbounded aggregators
• Recursive utility and optimal growth with bounded or unbounded returns
• Measurable selections of extrema
• Existence and Uniqueness of a Fixed Point for Local Contractions
• On Continuity of the Utility Function in Intertemporal Allocation Models: An Example
• Existence of Stationary Correlated Equilibria with Symmetric Information for Discounted Stochastic Games
• Measurable relations
• Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
• Discounted Dynamic Programming
• Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case