Discounted Dynamic Programming
From MaRDI portal
Publication:5343970
DOI10.1214/aoms/1177700285zbMath0133.42805OpenAlexW2074232820MaRDI QIDQ5343970
Publication date: 1965
Published in: The Annals of Mathematical Statistics (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1214/aoms/1177700285
Related Items (only showing first 100 items - show all)
Existence of optimal stationary policies in discounted Markov decision processes: Approaches by occupation measures ⋮ Decomposition in multi-item inventory control ⋮ On \(\epsilon\)-optimal continuous selectors and their application in discounted dynamic programming ⋮ On the complexity of linear quadratic control ⋮ The effect of interest rates on consumption in an income fluctuation problem ⋮ Optimal strategies for the multi-task inventory control model ⋮ Markovian equilibrium in a class of stochastic games: Existence theorems for discounted and undiscounted models ⋮ A general-equilibrium intertemporal model of an open economy ⋮ On the generic nonconvergence of Bayesian actions and beliefs ⋮ Computational aspects in applied stochastic control ⋮ Matching, search, and bargaining ⋮ Utility, probabilistic constraints, mean and variance of discounted rewards in Markov decision processes ⋮ The existence of good Markov strategies for decision processes with general payoffs ⋮ Linear quadratic game of exploitation of common renewable resources with inherent constraints ⋮ Biconvergent stochastic dynamic programming, asymptotic impatience, and `average' growth ⋮ Lipschitz continuous policy functions for strongly concave optimization problems ⋮ Stability estimates for controlled Markov chains with a minorant ⋮ Optimale Innovationspolitik bei unvollständiger Information. (Optimal innovation policy under incomplete information) ⋮ Discount-isotone policies for Markov decision processes ⋮ Belief distorted Nash equilibria: introduction of a new kind of equilibrium in dynamic games with distorted information ⋮ A generalized model of commitment ⋮ Envelope condition method with an application to default risk models ⋮ The Bellman's principle of optimality in the discounted dynamic programming ⋮ A strategic market game with secured lending ⋮ Optimal growth with many consumers ⋮ Robust optimal strategies in Markov decision problems ⋮ Global asymptotic stability results for multisector models of optional growth under uncertainty when future utilities are discounted ⋮ Controlled semi-Markov models - the discounted case ⋮ On determining the importance of attributes with a stopping problem ⋮ Theory of dynamic portfolio for survival under uncertainty ⋮ Discounting axioms imply risk neutrality ⋮ Symmetric paths and evolution to equilibrium in the discounted prisoners' dilemma ⋮ Constructions of Nash equilibria in stochastic games of resource extraction with additive transition structure ⋮ On Nikaido-Isoda type theorems for discounted stochastic games ⋮ Robust Markov control processes ⋮ Subgame perfect equilibria in discounted stochastic games ⋮ Blockbusting: brokers and the dynamics of segregation ⋮ On optimality criteria for dynamic programs with long finite horizons ⋮ On theory and algorithms for Markov decision problems with the total reward criterion ⋮ Invariant problems in dynamic programming - average reward criterion ⋮ On the existence and uniqueness of value functions in models of labor market dynamics ⋮ Conditions for characterizing the structure of optimal strategies in infinite-horizon dynamic programs ⋮ Discounted dynamic programming with unbounded returns: application to economic models ⋮ Asset pricing in a Lucas fruit-tree economy with the best and worst in mind ⋮ Control: a perspective ⋮ Sequential process control under capacity constraints. ⋮ Herbert Robbins and sequential analysis ⋮ Denumerable semi-Markov decision chains with small interest rates ⋮ On variable discounting in dynamic programming: applications to resource extraction and other economic models ⋮ On the existence of optimal processes in non-stationary environments ⋮ Estimation and control in multichain processes ⋮ Stochastic dynamic models with stock-dependent rewards ⋮ Learning in mis-specified models and the possibility of cycles ⋮ Stochastic games of resource extraction ⋮ Finite automata equilibria with discounting ⋮ An abstract topological approach to dynamic programming ⋮ Irreversibility and the behavior of aggregate stochastic growth models ⋮ Dynamic mechanism design with interdependent valuations ⋮ Prestable strategies in discounted duopoly games ⋮ Optimal pricing against a simple learning rule ⋮ Dynamics in \textit{Art of war} ⋮ A note on negative dynamic programming for risk-sensitive control ⋮ Stochastic games with unbounded payoffs: applications to robust control in economics ⋮ A stochastic model for the economic management of a renewable animal resource ⋮ Controlled jump processes ⋮ On dynamic programming: Compactness of the space of policies ⋮ On stopped decision processes with discrete time parameter ⋮ Estimates for finite-stage dynamic programs ⋮ The effect on optimal consumption on increased uncertainty in labor income in the multiperiod case ⋮ Markov programming by successive approximations with respect to weighted supremum norms ⋮ Multiple feedback at a single-server station ⋮ Discounted Markov games; successive approximation and stopping times ⋮ Stochastic evolution and control of an economic activity ⋮ Discounted, positive, and noncooperative stochastic games ⋮ Good news and bad news in two-armed bandits ⋮ Optimal systems for equipment maintenance and replacement under Markovian deterioration ⋮ Markov decision processes and strongly excessive functions ⋮ On some aspects in stochastic dynamic programming with terminal region ⋮ Perturbation theory for games in normal form and stochastic games ⋮ Bounded variation of \(\{V_ n\}\) and its limit ⋮ Markov-type fuzzy decision processes with a discounted reward on a closed interval ⋮ Recursive utility and the Ramsey problem ⋮ Mixed Markov decision processes in a semi-Markov environment with discounted criterion ⋮ Optimal strategies for an inventory system with cost functions of general form ⋮ Optimal Markov strategies ⋮ Optimality, equilibrium, and curb sets in decision problems without commitment ⋮ Markov equilibria in discounted stochastic games ⋮ On maximizing the average time at a goal ⋮ Transformation of partially observable Markov decision processes into piecewise linear ones ⋮ A strategic market game with active bankruptcy ⋮ Existence of equilibrium stationary strategies in discounted noncooperative stochastic games with uncountable state space ⋮ Optimal research and development expenditures under an incremental tax incentive scheme ⋮ Conditions for the existence of decision horizons for discounted problems in a stochastic environment: A note ⋮ Two-player stochastic games. I: A reduction ⋮ Risk, uncertainty, and complexity ⋮ Isotone policies for the value iteration method for Markov decision processes ⋮ On continuous-time discounted stochastic dynamic programming ⋮ Comparative statics in dynamic programming models with an application to job search ⋮ Nonrandomized strategy equilibria in noncooperative stochastic games with additive transition and reward structure ⋮ Optimal control of a facility with periodic interrupted demand
This page was built for publication: Discounted Dynamic Programming
