An envelope theorem and some applications to discounted Markov decision processes

DOI10.1007/s00186-007-0155-zzbMath1149.90171WikidataQ126267740 ScholiaQ126267740MaRDI QIDQ2483011

Raúl Montes-De-oca, Hugo Cruz-Suárez

Publication date: 5 May 2008

Published in: Mathematical Methods of Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s00186-007-0155-z

zbMATH Keywords

economic growth model; differentiablity of the optimal policy; differentiablity of the optimal value function

Mathematics Subject Classification ID

93E20: Optimal stochastic control

90C40: Markov and semi-Markov decision processes

Related Items

Suboptimal Policies for Stochastic $$N$$-Stage Optimization: Accuracy Analysis and a Case Study from Optimal Consumption, Envelope theorems in Banach lattices and asset pricing, A version of the Euler equation in discounted Markov decision processes, Approximate dynamic programming for stochastic \(N\)-stage optimization with application to optimal consumption under uncertainty, Unnamed Item, Ramsey’s Discrete-Time Growth Model: A Markov Decision Approach with Stochastic Labor

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Value iteration and rolling plans for Markov control processes with unbounded rewards
• A new look at optimal growth under uncertainty
• Characterization of optimal plans for stochastic dynamic programs
• Conditions for the uniqueness of optimal policies of discounted Markov decision processes
• On the Differentiability of the Value Function in Dynamic Models of Economics
• Smoothness, Comparative Dynamics, and the Turnpike Property
• Mathematical Methods and Models for Economists
• Envelope Theorems for Arbitrary Choice Sets
• Smooth dynamics and computation in models of economic growth