| Publication | Date of Publication | Type |
|---|
Approximations with performance bounds for a class of average cost Markov decision processes with weakly continuous kernel and unbounded cost function Applied Mathematics and Optimization | 2026-05-29 | Paper |
On compactness properties of subsets of probability measures on metric spaces Boletín de la Sociedad Matemática Mexicana. Third Series | 2026-03-20 | Paper |
| A note on the policy iteration algorithm for discounted Markov decision processes for a class of semicontinuous models | 2023-07-13 | Paper |
| A note on compact and {\sigma}-compact subsets of probability measures on metric spaces with an application to the distribution free newsvendor problem | 2023-07-13 | Paper |
Partially observable Markov decision processes with partially observable random discount factors Kybernetika | 2023-02-21 | Paper |
Zero-sum average cost semi-Markov games with weakly continuous transition probabilities and a minimax semi-Markov inventory problem Acta Applicandae Mathematicae | 2022-03-23 | Paper |
| scientific article; zbMATH DE number 7232794 (Why is no real title available?) | 2020-08-11 | Paper |
A perturbation approach to approximate value iteration for average cost Markov decision processes with Borel spaces and bounded costs. Kybernetika | 2019-08-05 | Paper |
Estimate and approximate policy iteration algorithm for discounted Markov decision models with bounded costs and Borel spaces Risk and Decision Analysis | 2019-03-12 | Paper |
Solutions of the average cost optimality equation for Markov decision processes with weakly continuous kernel: the fixed-point approach revisited Journal of Mathematical Analysis and Applications | 2018-05-09 | Paper |
On the regularity property of semi-Markov processes with Borel state spaces Optimization, Control, and Applications of Stochastic Systems | 2017-11-22 | Paper |
A perturbation approach to a class of discounted approximate value iteration algorithms with Borel spaces Journal of Dynamics and Games | 2016-10-25 | Paper |
On the vanishing discount factor approach for Markov decision processes with weakly continuous transition probabilities Journal of Mathematical Analysis and Applications | 2015-03-19 | Paper |
| scientific article; zbMATH DE number 6320164 (Why is no real title available?) | 2014-07-23 | Paper |
Optimal strategies for adaptive zero-sum average Markov games Journal of Mathematical Analysis and Applications | 2013-04-22 | Paper |
Asymptotically optimal strategies for adaptive zero-sum discounted Markov games SIAM Journal on Control and Optimization | 2010-06-10 | Paper |
Time and Ratio Expected Average Cost Optimality for Semi-Markov Control Processes on Borel Spaces Communications in Statistics: Theory and Methods | 2005-01-14 | Paper |
The average cost optimality equation: a fixed point approach Boletín de la Sociedad Matemática Mexicana. Third Series | 2004-06-11 | Paper |
Zero-Sum Average Semi-Markov Games: Fixed-Point Solutions of the Shapley Equation SIAM Journal on Control and Optimization | 2004-01-08 | Paper |
| scientific article; zbMATH DE number 970671 (Why is no real title available?) | 2001-11-21 | Paper |
Sample-path average cost optimality for semi-Markov control processes on Borel spaces: unbounded costs and mean holding times Applicationes Mathematicae | 2001-01-07 | Paper |
Sample path average optimality of Markov control processes with strictly unbounded cost Applicationes Mathematicae | 2001-01-07 | Paper |
Application of average dynamic programming to inventory systems Mathematical Methods of Operations Research | 2000-07-25 | Paper |
Sample-Path Optimality and Variance-Minimization of Average Cost Markov Control Processes SIAM Journal on Control and Optimization | 2000-03-19 | Paper |
A counterexample on overtaking optimality Mathematical Methods of Operations Research | 1999-09-22 | Paper |
Infinite-horizon Markov control processes with undiscounted cost criteria: from average to overtaking optimality Applicationes Mathematicae | 1998-06-02 | Paper |
| scientific article; zbMATH DE number 825219 (Why is no real title available?) | 1996-09-30 | Paper |
| scientific article; zbMATH DE number 790731 (Why is no real title available?) | 1995-09-27 | Paper |