Performance analysis for controlled semi-Markov systems with application to maintenance
From MaRDI portal
Publication:639926
DOI10.1007/s10957-011-9813-7zbMath1222.90076MaRDI QIDQ639926
Xianping Guo, Yong-hui Huang, Xin-Yuan Song
Publication date: 11 October 2011
Published in: Journal of Optimization Theory and Applications (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/s10957-011-9813-7
iteration algorithm; optimal value function; target set; optimal policy; controlled semi-Markov processes
90B25: Reliability, availability, maintenance, inspection in operations research
90C40: Markov and semi-Markov decision processes
Related Items
A minimization problem of the risk probability in first passage semi-Markov decision processes with loss rates, A probability criterion for zero-sum stochastic games, The risk probability criterion for discounted continuous-time Markov decision processes, A risk minimization problem for finite horizon semi-Markov decision processes with loss rates, Coupling based estimation approaches for the average reward performance potential in Markov chains
Cites Work
- Unnamed Item
- Unnamed Item
- Mean time to failure and availability of semi-Markov missions with maximal repair
- Semi-Markov information model for revenue management and dynamic pricing
- A policy gradient method for semi-Markov decision processes with application to call admission control
- Zero-sum ergodic semi-Markov games with weakly continuous transition probabilities
- Nonstationary value-iteration and adaptive control of discounted semi- Markov processes
- Controlled semi-Markov models - the discounted case
- Stochastic optimal control. The discrete time case
- Denumerable semi-Markov decision chains with small interest rates
- Criteria for selecting the relaxation factor of the value iteration algorithm for undiscounted Markov and semi-Markov decision processes
- A discrete semi-Markov decision model to determine the optimal repair/replace- ment policy under general repairs
- Controlled semi-Markov models under long-run average rewards
- A semi-Markov model of a manpower system
- A Pricing Process with Stochastic Volatility Controlled by a Semi-Markov Process
- Partially Observable Semi-Markov Games with Discounted Payoff
- Time-average optimal constrained semi-Markov decision processes
- Successive Approximations for Finite Horizon, Semi-Markov Decision Processes with Application to Asset Liquidation
- Arbitrary state semi-Markov decision processes
- On Evaluating the Performability of Degradable Computing Systems
- Semi-Markov decision processes with polynomial reward
- On the Second Optimality Equation for Semi-Markov Decision Models
- Cost rate heuristics for semi-Markov decision processes
- Performance-Related Reliability Measures for Computing Systems
- Evaluation of Performability for Degradable Computer Systems
- Linear programming in tector criterion markov and semi-Markov decision processes
- Approximation solution and suboptimality for discounted semi-markov decision problems with countable state space
- Average Optimality in Markov Control Processes via Discounted-Cost Problems and Linear Programming
- Semi-markov decision problems and performance sensitivity analysis
- An Infinite-Dimensional Linear Programming Algorithm for Deterministic Semi-Markov Decision Processes on Borel Spaces
