On Sequential Decisions and Markov Chains

From MaRDI portal
Publication:2778991

DOI10.1287/mnsc.9.1.16zbMath0995.90621OpenAlexW2146835059MaRDI QIDQ2778991

Derman Cyrus

Publication date: 22 October 2002

Published in: Management Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/mnsc.9.1.16



Related Items

On undiscounted semi-Markov decision processes with absorbing states, Synthesizing Efficient Controllers, A partial history of the early development of continuous-time nonlinear stochastic systems theory, Synthesizing efficient systems in probabilistic environments, Perspectives of approximate dynamic programming, Impact of supply risks on procurement decisions, Stable sequential control rules and Markov chains, Markovian sequential control processes. Denumerable state space, Average Cost Markov Decision Processes with Weakly Continuous Transition Probabilities, Some basic concepts of numerical treatment of Markov decision models, Optimal preventive maintenance for equipment with two quality states and general failure time distributions, Sorbe una aplicacion de los procesos de renovacion markovianos a los juegos estocasticos no terminativos, Constrained Semi-Markov decision processes with average rewards, On the life and work of Cyrus Derman, Derman's book as inspiration: some results on LP for MDPs, Discounting axioms imply risk neutrality, Programming with linear fractional functionals, Computing semi-stationary optimal policies for multichain semi-Markov decision processes, The tolerance approach in multiobjective linear fractional programming, Optimal a priori tour and restocking policy for the single-vehicle routing problem with stochastic demands, Stochastic shortest path problems with associative accumulative criteria, Fractional programming: Applications and algorithms, Submixing and shift-invariant stochastic games, MF-OMO: An Optimization Formulation of Mean-Field Games, Strong polynomiality of the Gass-Saaty shadow-vertex pivoting rule for controlled random walks, Capital accumulation and the optimization of renewable resource models, Unnamed Item, Optimal dynamic routing in flexible manufacturing systems with limited buffers, Optimal threshold probability in undiscounted Markov decision processes with a target set., Optimal maintenance scheduling for a complex manufacturing system subject to deterioration, Fractional programming, A survey of maintenance models: The control and surveillance of deteriorating systems, Semi-Markov decision processes with limiting ratio average rewards, Markov ratio decision processes, Optimal threshold probability and expectation in semi-Markov decision processes, Solving stochastic dynamic programming problems by linear programming — An annotated bibliography, Markov Branching Decision Chains with Interest-Rate-Dependent Rewards, Optimization of a fully adaptive quality and maintenance model in the presence of multiple location and scale quality shifts, The optimization of K-effect models by linear and dynamic programming, Some remarks on a Markovian decision problem with an absorbing state, Linear programming considerations on Markovian decision processes with no discounting, Linear programming algorithms for semi-Markovian decision processes, On the optimal long run control of Markov renewal processes, A new optimality criterion for discrete dynamic programming, Equivalence of various linearization algorithms for linear fractional programming, On the solvability of Bellman's functional equation for a Markovian decision process, Maximum-Stopping-Value Policies in Finite Markov Population Decision Chains, Adaptive Policies in Markov Decision Processes with Uncertain Transition Matrices, Numerical comparison of controls and verification of optimality for stochastic control problems, On maximizing the average time at a goal, Conditions for the existence of decision horizons for discounted problems in a stochastic environment: A note, Look-back policies for two-stage, pull-type production/inventory systems, Mean-performance of sharp restart I: statistical roadmap, Bibliography in fractional programming, Tail-behavior roadmap for sharp restart