Stochastic comparative statics in Markov decision processes
From MaRDI portal
Publication:5000655
Abstract: In multi-period stochastic optimization problems, the future optimal decision is a random variable whose distribution depends on the parameters of the optimization problem. We analyze how the expected value of this random variable changes as a function of the dynamic optimization parameters in the context of Markov decision processes. We call this analysis emph{stochastic comparative statics}. We derive both emph{comparative statics} results and emph{stochastic comparative statics} results showing how the current and future optimal decisions change in response to changes in the single-period payoff function, the discount factor, the initial state of the system, and the transition probability function. We apply our results to various models from the economics and operations research literature, including investment theory, dynamic pricing models, controlled random walks, and comparisons of stationary distributions.
Recommendations
Cites work
- scientific article; zbMATH DE number 52448 (Why is no real title available?)
- scientific article; zbMATH DE number 3574704 (Why is no real title available?)
- A constructive study of Markov equilibria in stochastic games with strategic complementarities
- A qualitative approach to Markovian equilibrium in infinite horizon economies with capital
- Comparative Statics by Adaptive Dynamics and the Correspondence Principle
- Comparative Statics, Informativeness, and the Interval Dominance Order
- Comparative statics for the consumer problem
- Comparison methods for stochastic models and risks
- Directional monotone comparative statics
- Distributional comparative statics
- Dynamic Pricing Strategies with Reference Effects
- Dynamic optimization. Deterministic and stochastic models
- Entry, Exit, and firm Dynamics in Long Run Equilibrium
- How Does the Value Function of a Markov Decision Process Depend on the Transition Probabilities?
- Index-wise comparative statics
- Inventory Dynamics and Supply Chain Coordination
- Mean field equilibrium in dynamic games with strategic complementarities
- Minimizing a Submodular Function on a Lattice
- Monotone Comparative Statics
- Monotone Comparative Statics under Uncertainty
- One-Sector Nonclassical Optimal Growth: Optimality Conditions and Comparative Dynamics
- Optimal control of random walks, birth and death processes, and queues
- Ordered Solutions for Dynamic Programs
- Partially observable total-cost Markov decision processes with weakly continuous transition probabilities
- Partially observed Markov decision processes. From filtering to controlled sensing
- Precautionary Wealth Accumulation
- Risk Aversion, Information Acquisition, and Technology Adoption
- Stochastic Monotonicity and Stationary Distributions for Dynamic Economies
- Stochastic Order Relations and Lattices of Probability Measures
- Stochastic optimal control. The discrete time case
- Stochastic orders
- Stochastic stability in monotone economies
- Stochastic stability of monotone economies in regenerative environments
- Structural Properties of Stochastic Dynamic Programs
- The Comparative Statics of Constrained Optimization Problems
- The effect of interest rates on consumption in an income fluctuation problem
- The risk-free rate in heterogeneous-agent incomplete-insurance economies
- Welfare variations and the comparative statics of demand
Cited in
(5)- Stochastic revision opportunities in Markov decision problems
- Comparative statics in dynamic stochastic models. Differential analysis of a stochastic modified golden rule state in a Banach space
- scientific article; zbMATH DE number 1017502 (Why is no real title available?)
- Comparative statics under uncertainty for a class of economic agents
- A note on comparative statics and stochastic dominance
This page was built for publication: Stochastic comparative statics in Markov decision processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5000655)
