Sample-Path Optimality and Variance-Minimization of Average Cost Markov Control Processes
From MaRDI portal
Publication:4943713
DOI10.1137/S0363012998340673zbMath0951.93074MaRDI QIDQ4943713
Óscar Vega-Amaya, Onésimo Hernández-Lerma, Guadalupe Carrasco
Publication date: 19 March 2000
Published in: SIAM Journal on Control and Optimization (Search for Journal in Brave)
average costsample-pathdiscrete-time Markov control processesaverage cost criteriaexpected average cost
Related Items (30)
Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces ⋮ Markov Decision Processes with Variance Minimization: A New Condition and Approach ⋮ Finite horizon continuous-time Markov decision processes with mean and variance criteria ⋮ Bias optimality and strong \(n\) \((n= -1,0)\) discount optimality for Markov decision processes ⋮ Unnamed Item ⋮ Controlled Switching Diffusions Under Ambiguity: The Average Criterion ⋮ Optimization of Markov decision processes under the variance criterion ⋮ A mean-variance optimization problem for discounted Markov decision processes ⋮ Mean-variance problems for finite horizon semi-Markov decision processes ⋮ Sample-Path Optimal Stationary Policies in Stable Markov Decision Chains with the Average Reward Criterion ⋮ First Passage Optimality and Variance Minimisation of Markov Decision Processes with Varying Discount Factors ⋮ Strong \(n\)-discount and finite-horizon optimality for continuous-time Markov decision processes ⋮ A unified algorithm framework for mean-variance optimization in discounted Markov decision processes ⋮ Mean-variance optimization of discrete time discounted Markov decision processes ⋮ Average sample-path optimality for continuous-time Markov decision processes in Polish spaces ⋮ Bias and Overtaking Optimality for Continuous-Time Jump Markov Decision Processes in Polish Spaces ⋮ Another Set of Conditions for Strongn(n = −1, 0) Discount Optimality in Markov Decision Processes ⋮ Sample-path optimality and variance-maximization for Markov decision processes ⋮ Variance minimization of parameterized Markov decision processes ⋮ Solutions of the average cost optimality equation for Markov decision processes with weakly continuous kernel: the fixed-point approach revisited ⋮ Optimal ergodic control of Markov diffusion processes with minimum variance ⋮ Asymptotic Normality of Discrete-Time Markov Control Processes ⋮ Markov control processes with pathwise constraints ⋮ Another set of conditions for Markov decision processes with average sample-path costs ⋮ A Sensitivity‐Based Construction Approach to Variance Minimization of Markov Decision Processes ⋮ A perturbation approach to approximate value iteration for average cost Markov decision processes with Borel spaces and bounded costs ⋮ Variance minimization and the overtaking optimality approach to continuous-time controlled Markov chains ⋮ Semi-Markov decision processes with variance minimization criterion ⋮ Variance-minimization of Markov control processes with pathwise constraints ⋮ Zero-sum average cost semi-Markov games with weakly continuous transition probabilities and a minimax semi-Markov inventory problem
This page was built for publication: Sample-Path Optimality and Variance-Minimization of Average Cost Markov Control Processes