Dynamic programming with state-dependent discounting
From MaRDI portal
Publication:1995327
Abstract: This paper extends the core results of discrete time infinite horizon dynamic programming to the case of state-dependent discounting. We obtain a condition on the discount factor process under which all of the standard optimality results can be recovered. We also show that the condition cannot be significantly weakened. Our framework is general enough to handle complications such as recursive preferences and unbounded rewards. Economic and financial applications are discussed.
Recommendations
- Discounted dynamic programming with unbounded returns: application to economic models
- On maximin dynamic programming and the rate of discount
- Stochastic dynamic programming with non-linear discounting
- Generalised discounting in dynamic programming with unbounded returns
- On variable discounting in dynamic programming: applications to resource extraction and other economic models
Cites work
- scientific article; zbMATH DE number 3148886 (Why is no real title available?)
- scientific article; zbMATH DE number 52448 (Why is no real title available?)
- scientific article; zbMATH DE number 3365771 (Why is no real title available?)
- Abstract dynamic programming
- Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
- Convex dynamic programming with (bounded) recursive utility
- Discounted Dynamic Programming
- Discretizing nonlinear, non-Gaussian Markov processes with exact conditional moments
- Dynamic programming and optimal control. Vol. 1.
- Dynamic programming with homogeneous functions
- Existence and Uniqueness of Solutions to the Bellman Equation in the Unbounded Case
- Existence and uniqueness of a fixed point for local contractions
- Functional analysis
- Identifying long-run risks: a Bayesian mixed-frequency approach
- Infinite dimensional analysis. A hitchhiker's guide.
- Long-Term Risk: A Martingale Approach
- Long-Term Risk: An Operator Approach
- Mood fluctuations, projection bias, and volatility of equity prices
- On discounted dynamic programming with unbounded returns
- On the Differentiability of the Value Function in Dynamic Models of Economics
- Optimal fiscal and monetary policy with occasionally binding zero bound constraints
- Order structure and topological methods in nonlinear partial differential equations. Vol. 1. Maximum principles and applications
- Recursive equilibrium in Krusell and Smith (1998)
- Saving behavior in stationary equilibrium with random discounting
- Substitution, Risk Aversion, and the Temporal Behavior of Consumption and Asset Returns: A Theoretical Framework
- The income fluctuation problem and the evolution of wealth
- The uncertainty multiplier and business cycles
- Uncertainty Shocks in a Model of Effective Demand: Comment
- Uncertainty shocks in a model of effective demand
- Unique solutions for stochastic recursive utilities
Cited in
(10)- Stochastic dynamic programming with non-linear discounting
- scientific article; zbMATH DE number 3963596 (Why is no real title available?)
- Discounted Dynamic Programming
- Do not blame Bellman: it is Koopmans' fault
- Perov's contraction principle and dynamic programming with stochastic discounting
- Now decision theory
- The dynamic programming method in systems with states in the form of distributions
- On variable discounting in dynamic programming: applications to resource extraction and other economic models
- Asset pricing with time preference shocks: existence and uniqueness
- Interest rate dynamics and commodity prices
This page was built for publication: Dynamic programming with state-dependent discounting
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1995327)