Markov programming by successive approximations with respect to weighted supremum norms

DOI10.1016/0022-247X(77)90210-4zbMath0354.90087OpenAlexW1971259522MaRDI QIDQ1236975

Publication date: 1977

Published in: Journal of Mathematical Analysis and Applications (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/0022-247x(77)90210-4

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Markov processes (60Jxx)

Related Items

Constrained discounted stochastic games, Finite-state approximations for denumerable state discounted Markov decision processes, Unbounded dynamic programming via the Q-transform, A finite algorithm for \(\epsilon\)-optimal solutions of adaptive queueing control, The existence of sensitive optimal policies in two multi-dimensional queueing models, Regime switching optimal growth model with risk sensitive preferences, New exactly solvable examples for controlled discrete-time Markov chains, An optimal policy for joining a queue in processing two kinds of jobs, On symmetric stochastic games of resource extraction with weakly continuous transitions, Equilibria in altruistic economic growth models, Markov perfect equilibria in a dynamic decision model with quasi-hyperbolic discounting, Robustness inequality for Markov control processes with unbounded costs, On approximate and weak correlated equilibria in constrained discounted stochastic games, On theory and algorithms for Markov decision problems with the total reward criterion, Stochastic optimal growth model with risk sensitive preferences, Solving linear systems by methods based on a probabilistic interpretation, Conditions for characterizing the structure of optimal strategies in infinite-horizon dynamic programs, On the expected total reward with unbounded returns for Markov decision processes, Discounted dynamic programming with unbounded returns: application to economic models, A Verification Theorem for Threshold-Indexability of Real-State Discounted Restless Bandits, Action-dependent stopping times and Markov decision process with unbounded rewards, Discounted semi-markov decision process in a semi-markov environment, Unique solutions for stochastic recursive utilities, First-order sensitivity of the optimal value in a Markov decision model with respect to deviations in the transition probability function, Stochastic dynamic programming with non-linear discounting, Dynamic coordination of production planning and sales admission control in the presence of a spot market, On Markov games, On a sequential two-action decision model¹with unbounded reward functions, Stochastic games with unbounded payoffs: applications to robust control in economics, R-theory for countable reducible nonnegative matrices, Markov decision processes with quasi-hyperbolic discounting, Bounds on the fixed point of a monotone contraction operator, Generalised discounting in dynamic programming with unbounded returns, Markov decision processes and strongly excessive functions, Constrained discounted Markov decision processes with Borel state spaces, Recursive utility and the Ramsey problem, On the convergence of successive approximations in dynamic programming with non-zero terminal reward, Unnamed Item, Finite state approximations for denumerable state infinite horizon discounted Markov decision processes with unbounded rewards, \(K\) competing queues with customer abandonment: optimality of a generalised \(c \mu \)-rule by the smoothed rate truncation method, Unnamed Item, MARKOV DECISION PROCESSES, Isotone policies for the value iteration method for Markov decision processes, An optimal maintenance policy for a server with decreasing arrival rate.

Cites Work