scientific article; zbMATH DE number 3445938
From MaRDI portal
Publication:4771778
zbMath0284.49012MaRDI QIDQ4771778
Publication date: 1974
Title: zbMATH Open Web Interface contents unavailable due to conflicting licenses.
Stochastic systems and control (93E99) Decision theory (91B06) Discrete-time Markov processes on general state spaces (60J05) Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Probabilistic potential theory (60J45) Optimal stopping in statistics (62L15) Mathematical programming (90C99) Research exposition (monographs, survey articles) pertaining to probability theory (60-02) Research exposition (monographs, survey articles) pertaining to calculus of variations and optimal control (49-02) Hamilton-Jacobi theories (49L99)
Related Items (60)
Stability Estimation of Transient Markov Decision Processes ⋮ Markov decision processes with a minimum-variance criterion ⋮ Unnamed Item ⋮ The existence of good Markov strategies for decision processes with general payoffs ⋮ Necessary and sufficient conditions for a bounded solution to the optimality equation in average reward Markov decision chains ⋮ Explicit optimal value for Dynkin's stopping game ⋮ Strong 1-optimal stationary policies in denumerable Markov decision processes ⋮ Finite state dynamic programming with the total reward criterion ⋮ An expected average reward criterion ⋮ On confidence intervals from simulation of finite Markov chains ⋮ Connectedness conditions used in finite state Markov decision processes ⋮ Constrained Semi-Markov decision processes with average rewards ⋮ A pause control approach to the value iteration scheme in average Markov decision processes ⋮ Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion ⋮ Sample-Path Optimal Stationary Policies in Stable Markov Decision Chains with the Average Reward Criterion ⋮ Risk-Averse Stochastic Programming: Time Consistency and Optimal Stopping ⋮ On theory and algorithms for Markov decision problems with the total reward criterion ⋮ Fractional programming: Applications and algorithms ⋮ Two characterizations of optimality in dynamic programming ⋮ Recent results on conditions for the existence of average optimal stationary policies ⋮ Adaptive control of constrained Markov chains: Criteria and policies ⋮ Denumerable semi-Markov decision chains with small interest rates ⋮ The average cost of Markov chains subject to total variation distance uncertainty ⋮ Conditions for optimality in dynamic programming and for the limit of n-stage optimal policies to be optimal ⋮ Estimation and control in multichain processes ⋮ A counterexample on sample-path optimality in stable Markov decision chains with the average reward criterion ⋮ A note on the vanishing interest rate approach in average Markov decision chains with continuous and bounded costs ⋮ On strong average optimality of Markov decision processes with unbounded costs ⋮ Transient policies in discrete dynamic programming: Linear programming including suboptimality tests and additional constraints ⋮ R-theory for countable reducible nonnegative matrices ⋮ On stopped decision processes with discrete time parameter ⋮ Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations ⋮ Solving stochastic dynamic programming problems by linear programming — An annotated bibliography ⋮ Multiple feedback at a single-server station ⋮ Phase Transitions for Controlled Markov Chains on Infinite Graphs ⋮ Ergodic potential ⋮ Markov decision processes and strongly excessive functions ⋮ Denumerable controlled Markov chains with average reward criterion: Sample path optimality ⋮ Nonzero-Sum Risk-Sensitive Stochastic Games on a Countable State Space ⋮ Characterization of the Optimal Risk-Sensitive Average Cost in Denumerable Markov Decision Chains ⋮ On the convergence of successive approximations in dynamic programming with non-zero terminal reward ⋮ [Russian Text Ignored.] ⋮ <html> Nash ε-equilibria for stochastic games with total reward functions: an approach through Markov decision processes</html> ⋮ Characterization and sufficient conditions for normed ergodicity of Markov chains ⋮ Geometric Ergodicity of the ALOHA-system and a Coupled Processors Model ⋮ Constrained Discounted Markov Decision Chains ⋮ On the reduction of total‐cost and average‐cost MDPs to discounted MDPs ⋮ Long-term average cost control problems for continuous time Markov processes: A survey ⋮ Unnamed Item ⋮ On maximizing the average time at a goal ⋮ Optimal and near-optimal inventory control policies for a make-to-order inventory-production system ⋮ Optimal policy for minimizing risk models in Markov decision processes ⋮ Continuity of mean recurrence times in denumerable semi-Markov processes ⋮ Sensitivity analysis in discounted Markovian decision problems ⋮ Finite state Markov decision models with average reward criteria ⋮ Finite state approximation algorithms for average cost denumerable state Markov decision processes ⋮ On essential information in sequential decision processes ⋮ CHARACTERIZATIONS OF OPTIMAL POLICIES IN A GENERAL STOPPING PROBLEM AND STABILITY ESTIMATING ⋮ Continuity of the optimal average cost in Markov decision chains with small risk-sensitivity ⋮ Bibliography in fractional programming
This page was built for publication:
