On Sequential Decisions and Markov Chains

From MaRDI portal
Revision as of 15:05, 3 February 2024 by Import240129110113 (talk | contribs) (Created automatically from import240129110113)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Publication:2778991

DOI10.1287/MNSC.9.1.16zbMath0995.90621OpenAlexW2146835059MaRDI QIDQ2778991

Derman Cyrus

Publication date: 22 October 2002

Published in: Management Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/mnsc.9.1.16




Related Items (55)

On undiscounted semi-Markov decision processes with absorbing statesSynthesizing Efficient ControllersA partial history of the early development of continuous-time nonlinear stochastic systems theorySynthesizing efficient systems in probabilistic environmentsPerspectives of approximate dynamic programmingImpact of supply risks on procurement decisionsStable sequential control rules and Markov chainsMarkovian sequential control processes. Denumerable state spaceAverage Cost Markov Decision Processes with Weakly Continuous Transition ProbabilitiesSome basic concepts of numerical treatment of Markov decision modelsOptimal preventive maintenance for equipment with two quality states and general failure time distributionsSorbe una aplicacion de los procesos de renovacion markovianos a los juegos estocasticos no terminativosConstrained Semi-Markov decision processes with average rewardsOn the life and work of Cyrus DermanDerman's book as inspiration: some results on LP for MDPsDiscounting axioms imply risk neutralityProgramming with linear fractional functionalsComputing semi-stationary optimal policies for multichain semi-Markov decision processesThe tolerance approach in multiobjective linear fractional programmingOptimal a priori tour and restocking policy for the single-vehicle routing problem with stochastic demandsStochastic shortest path problems with associative accumulative criteriaFractional programming: Applications and algorithmsSubmixing and shift-invariant stochastic gamesMF-OMO: An Optimization Formulation of Mean-Field GamesStrong polynomiality of the Gass-Saaty shadow-vertex pivoting rule for controlled random walksCapital accumulation and the optimization of renewable resource modelsUnnamed ItemOptimal dynamic routing in flexible manufacturing systems with limited buffersOptimal threshold probability in undiscounted Markov decision processes with a target set.Optimal maintenance scheduling for a complex manufacturing system subject to deteriorationFractional programmingA survey of maintenance models: The control and surveillance of deteriorating systemsSemi-Markov decision processes with limiting ratio average rewardsMarkov ratio decision processesOptimal threshold probability and expectation in semi-Markov decision processesSolving stochastic dynamic programming problems by linear programming — An annotated bibliographyMarkov Branching Decision Chains with Interest-Rate-Dependent RewardsOptimization of a fully adaptive quality and maintenance model in the presence of multiple location and scale quality shiftsThe optimization of K-effect models by linear and dynamic programmingSome remarks on a Markovian decision problem with an absorbing stateLinear programming considerations on Markovian decision processes with no discountingLinear programming algorithms for semi-Markovian decision processesOn the optimal long run control of Markov renewal processesA new optimality criterion for discrete dynamic programmingEquivalence of various linearization algorithms for linear fractional programmingOn the solvability of Bellman's functional equation for a Markovian decision processMaximum-Stopping-Value Policies in Finite Markov Population Decision ChainsAdaptive Policies in Markov Decision Processes with Uncertain Transition MatricesNumerical comparison of controls and verification of optimality for stochastic control problemsOn maximizing the average time at a goalConditions for the existence of decision horizons for discounted problems in a stochastic environment: A noteLook-back policies for two-stage, pull-type production/inventory systemsMean-performance of sharp restart I: statistical roadmapBibliography in fractional programmingTail-behavior roadmap for sharp restart







This page was built for publication: On Sequential Decisions and Markov Chains