Discrete Dynamic Programming with a Small Interest Rate

From MaRDI portal
Publication:5565564

DOI10.1214/aoms/1177697700zbMath0175.47302OpenAlexW2071453199MaRDI QIDQ5565564

Arthur F. jun. Veinott, Bruce L. Miller

Publication date: 1969

Published in: The Annals of Mathematical Statistics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aoms/1177697700




Related Items (30)

Variational characterizations in Markov decision processesAsymptotic expansions for dynamic programming recursions with general nonnegative matricesAn efficient basis update for asymptotic linear programmingA Mixed Value and Policy Iteration Method for Stochastic Control with Universally Measurable PoliciesStrong 1-optimal stationary policies in denumerable Markov decision processesA canonical form for pencils of matrices with applications to asymptotic linear programsBlackwell optimal policies in a Markov decision process with a Borel state spaceSurvey of linear programming for standard and nonstandard Markovian control problems. Part I: TheoryNonstationary Markov decision problems with converging parametersOptimal control of Markov chains admitting strong and weak interactionsResolvent expansions of matrices and applicationsSimultaneous recurrent conditions on countable state Markov chainsDenumerable semi-Markov decision chains with small interest ratesOn the convergence of the average expected return in dynamic programmingTransient policies in discrete dynamic programming: Linear programming including suboptimality tests and additional constraintsAn optimality principle for Markovian decision processesA Fixed Point Approach to Undiscounted Markov Renewal ProgramsBlackwell optimality in the class of Markov policies for continuous-time controlled Markov chainsA survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)Markov Branching Decision Chains with Interest-Rate-Dependent RewardsSolution of continuous-time markovian decision models using infinite linear programmingOn the functional equations in undiscounted and sensitive discounted stochastic gamesAre limits of \(\alpha\)-discounted optimal policies Blackwell optimal? A counterexampleStochastic Inventory Models with Limited Production Capacity and Periodically Varying ParametersFinite state multi-armed bandit problems: Sensitive-discount, average-reward and average-overtaking optimalityMaximum-Stopping-Value Policies in Finite Markov Population Decision ChainsUnnamed ItemSensitivity analysis in discounted Markovian decision problemsGeneralized eigenvectors and sets of nonnegative matricesMARKOV DECISION PROCESSES




This page was built for publication: Discrete Dynamic Programming with a Small Interest Rate