A version of the Euler equation in discounted Markov decision processes (Q1952742): Difference between revisions

From MaRDI portal
Importer (talk | contribs)
Created a new Item
 
ReferenceBot (talk | contribs)
Changed an Item
 
(6 intermediate revisions by 5 users not shown)
Property / author
 
Property / author: Hugo Cruz-Suárez / rank
Normal rank
 
Property / reviewed by
 
Property / reviewed by: Q749165 / rank
Normal rank
 
Property / author
 
Property / author: Hugo Cruz-Suárez / rank
 
Normal rank
Property / Wikidata QID
 
Property / Wikidata QID: Q58905696 / rank
 
Normal rank
Property / reviewed by
 
Property / reviewed by: Werner H. Schmidt / rank
 
Normal rank
Property / MaRDI profile type
 
Property / MaRDI profile type: MaRDI publication profile / rank
 
Normal rank
Property / full work available at URL
 
Property / full work available at URL: https://doi.org/10.1155/2012/103698 / rank
 
Normal rank
Property / OpenAlex ID
 
Property / OpenAlex ID: W2016648086 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q3795523 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q3237805 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q4863593 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q4255598 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q4002751 / rank
 
Normal rank
Property / cites work
 
Property / cites work: A note on uncertainty and discounting in models of economic growth / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q2892535 / rank
 
Normal rank
Property / cites work
 
Property / cites work: Stochastic optimal growth with bounded or unbounded utility and with bounded or unbounded shocks / rank
 
Normal rank
Property / cites work
 
Property / cites work: Two characterizations of optimality in dynamic programming / rank
 
Normal rank
Property / cites work
 
Property / cites work: Discounted dynamic programming with unbounded returns: application to economic models / rank
 
Normal rank
Property / cites work
 
Property / cites work: On optimal growth under uncertainty / rank
 
Normal rank
Property / cites work
 
Property / cites work: Q5389901 / rank
 
Normal rank
Property / cites work
 
Property / cites work: On the Differentiability of the Value Function in Dynamic Models of Economics / rank
 
Normal rank
Property / cites work
 
Property / cites work: An envelope theorem and some applications to discounted Markov decision processes / rank
 
Normal rank
Property / cites work
 
Property / cites work: Envelope Theorems for Arbitrary Choice Sets / rank
 
Normal rank
Property / cites work
 
Property / cites work: Convex Analysis / rank
 
Normal rank
Property / cites work
 
Property / cites work: Conditions for the uniqueness of optimal policies of discounted Markov decision processes / rank
 
Normal rank
Property / cites work
 
Property / cites work: Mathematical Methods and Models for Economists / rank
 
Normal rank
links / mardi / namelinks / mardi / name
 

Latest revision as of 11:17, 6 July 2024

scientific article
Language Label Description Also known as
English
A version of the Euler equation in discounted Markov decision processes
scientific article

    Statements

    A version of the Euler equation in discounted Markov decision processes (English)
    0 references
    0 references
    0 references
    0 references
    3 June 2013
    0 references
    The paper deals with optimal control problems in discrete time and with an infinite horizon. The problems are considered by means of the Markov decision processes theory. The optimal control problems are proposed to be solved with the dynamic programming technique. The optimal solution is characterized by a functional equation known as the dynamic programming equation. In simple cases, the value iteration procedure is used to approximate the optimal value function. However, this method does not work in more complicated functional forms. The essential tool used in the paper is the Euler equation, this equation is established and solved (in some cases empirically). The authors present an iterative method of finding the solution of the Euler equation in terms of the value iteration function. Under certain conditions, the validity of the Euler equation can be guaranteed. Using the maximizers' convergence of the optimal policy, the optimal control problem is solved. A linear quadratic problem illustrates the theory.
    0 references
    optimal control
    0 references
    Markov decision process
    0 references
    dynamic programming
    0 references
    Euler equation
    0 references
    optimal value function
    0 references
    value iteration function
    0 references

    Identifiers

    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references