Stochastic dynamic programming with non-linear discounting
From MaRDI portal
Abstract: In this paper, we study a Markov decision process with a non-linear discount function and with a Borel state space. We define a recursive discounted utility, which resembles non-additive utility functions considered in a number of models in economics. Non-additivity here follows from non-linearity of the discount function. Our study is complementary to the work of Ja'skiewicz, Matkowski and Nowak (Math. Oper. Res. 38 (2013), 108-121), where also non-linear discounting is used in the stochastic setting, but the expectation of utilities aggregated on the space of all histories of the process is applied leading to a non-stationary dynamic programming model. Our aim is to prove that in the recursive discounted utility case the Bellman equation has a solution and there exists an optimal stationary policy for the problem in the infinite time horizon. Our approach includes two cases: when the one-stage utility is bounded on both sides by a weight function multiplied by some positive and negative constants, and when the one-stage utility is unbounded from below.
Recommendations
- Persistently optimal policies in stochastic dynamic programming with generalized discounting
- Discounted dynamic programming with unbounded returns: application to economic models
- Publication:3486379
- Dynamic programming with state-dependent discounting
- Generalised discounting in dynamic programming with unbounded returns
Cites work
- scientific article; zbMATH DE number 3148886 (Why is no real title available?)
- scientific article; zbMATH DE number 3724212 (Why is no real title available?)
- scientific article; zbMATH DE number 52448 (Why is no real title available?)
- scientific article; zbMATH DE number 3498502 (Why is no real title available?)
- scientific article; zbMATH DE number 1325008 (Why is no real title available?)
- scientific article; zbMATH DE number 722611 (Why is no real title available?)
- scientific article; zbMATH DE number 1973375 (Why is no real title available?)
- scientific article; zbMATH DE number 3320878 (Why is no real title available?)
- scientific article; zbMATH DE number 3186512 (Why is no real title available?)
- Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal
- Contraction Mappings in the Theory Underlying Dynamic Programming
- Discounted Dynamic Programming
- Discounting long run average growth in stochastic dynamic programs
- Dynamic programming for non-additive stochastic objectives
- Economic dynamics in discrete time
- Generalised discounting in dynamic programming with unbounded returns
- Handbook of Markov decision processes. Methods and applications
- Markov decision processes with applications to finance.
- Markov programming by successive approximations with respect to weighted supremum norms
- Measurable selections of extrema
- Monotone Mappings with Application in Dynamic Programming
- On recursive utilities with non-affine aggregator and conditional certainty equivalent
- On variable discounting in dynamic programming: applications to resource extraction and other economic models
- Persistently optimal policies in stochastic dynamic programming with generalized discounting
- Recursive utility and the Ramsey problem
- Stationary Ordinal Utility and Impatience
- Stochastic games with unbounded payoffs: applications to robust control in economics
- Stochastic optimal control. The discrete time case
- Stochastic optimal growth model with risk sensitive preferences
Cited in
(11)- Computing non-stationary \((s, S)\) policies using mixed integer linear programming
- Stochastic discounting
- Time-consistent equilibria in dynamic models with recursive payoffs and behavioral discounting
- Long-Run Impulse Control with Generalized Discounting
- On finite approximations to Markov decision processes with recursive and nonlinear discounting
- Discounted dynamic programming with unbounded returns: application to economic models
- A note on a new class of recursive utilities in Markov decision processes
- scientific article; zbMATH DE number 3965846 (Why is no real title available?)
- Discounting long run average growth in stochastic dynamic programs
- Dynamic programming with state-dependent discounting
- Persistently optimal policies in stochastic dynamic programming with generalized discounting
This page was built for publication: Stochastic dynamic programming with non-linear discounting
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2234309)
