Parameterized Markov decision process and its application to service rate control
DOI10.1016/J.AUTOMATICA.2015.01.006zbMATH Open1318.93062OpenAlexW1974307281MaRDI QIDQ492972FDOQ492972
Authors: Li Xia, Qing-Shan Jia
Publication date: 21 August 2015
Published in: Automatica (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1016/j.automatica.2015.01.006
Recommendations
- Simulation-based optimization of Markov reward processes
- Simulation optimization algorithms for SMDPs with parameterized randomized stationary policies
- Bounded Parameter Markov Decision Processes with Average Reward Criterion
- Variance minimization of parameterized Markov decision processes
- scientific article; zbMATH DE number 970511
Markov decision processdiscrete event systemspolicy iterationparameterized policyservice rate control
Markov and semi-Markov decision processes (90C40) Discrete event control/observation systems (93C65) Optimal stochastic control (93E20)
Cites Work
- Discrete Optimization via Simulation Using COMPASS
- Title not available (Why is that?)
- Perturbation realization, potentials, and sensitivity analysis of Markov processes
- Continuous-time Markov decision processes. Theory and applications
- Stochastic learning and optimization. A sensitivity-based approach.
- Natural actor-critic algorithms
- Multivariate stochastic approximation using a simultaneous perturbation gradient approximation
- 10.1162/1532443041827907
- Simulation-based optimization of Markov reward processes
- Event-based optimization of admission control in open queueing networks
- Simulation budget allocation for further enhancing the efficiency of ordinal optimization
- Series expansions for continuous-time Markov processes
- SERIES EXPANSIONS FOR FINITE-STATE MARKOV CHAINS
- Closed Queuing Systems with Exponential Servers
- Handbook of Markov decision processes. Methods and applications
- Title not available (Why is that?)
- Estimating the Sojourn time sensitivity in queueing networks using perturbation analysis
- Perturbation analysis and optimization of queueing networks
- Max-Min Optimality of Service Rate Control in Closed Queueing Networks
- Service rate control of closed Jackson networks from game theoretic perspective
- Aggregation in Dynamic Programming
- On State Aggregation to Approximate Complex Value Functions in Large-Scale Markov Decision Processes
Cited In (6)
- Variance minimization of parameterized Markov decision processes
- Coupling based estimation approaches for the average reward performance potential in Markov chains
- Simulation budget allocation for simultaneously selecting the best and worst subsets
- An overview for Markov decision processes in queues and networks
- The risk probability criterion for discounted continuous-time Markov decision processes
- Optimal energy-efficient policies for data centers through sensitivity-based optimization
Uses Software
This page was built for publication: Parameterized Markov decision process and its application to service rate control
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q492972)