The vanishing discount approach to constrained continuous-time controlled Markov chains
From MaRDI portal
Publication:709279
DOI10.1016/j.sysconle.2010.06.012zbMath1198.49022MaRDI QIDQ709279
Onésimo Hernández-Lerma, Tomás Prieto-Rumeau
Publication date: 18 October 2010
Published in: Systems \& Control Letters (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1016/j.sysconle.2010.06.012
vanishing discount approach; constrained control models; continuous-time controlled Markov chains (CMCs)
93E20: Optimal stochastic control
60J27: Continuous-time Markov processes on discrete state spaces
49K45: Optimality conditions for problems involving randomness
Related Items
Controlled Switching Diffusions Under Ambiguity: The Average Criterion, The Lagrange and the vanishing discount techniques to controlled diffusions with cost constraints, Constrained Markov decision processes in Borel spaces: from discounted to average optimality, Constrained optimality for finite horizon semi-Markov decision processes in Polish spaces, Constrained stochastic games with the average payoff criteria, On the vanishing discount factor approach for Markov decision processes with weakly continuous transition probabilities, Optimality of Mixed Policies for Average Continuous-Time Markov Decision Processes with Constraints
Cites Work
- Existence and regularity of a nonhomogeneous transition matrix under measurability conditions
- Long-run average welfare in a pollution accumulation model
- A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
- Stochastic optimal policies when the discount rate vanishes
- Continuous-time Markov decision processes. Theory and applications
- What do discounted optima converge to!: A theory of discount rate asymptotics in economic models
- Continuous-time controlled Markov chains with discounted rewards
- The Laurent series, sensitive discount and Blackwell optimality for continuous-time controlled Markov chains
- Ergodic control in stochastic manufacturing systems with constant demand
- COMPUTING AVERAGE OPTIMAL CONSTRAINED POLICIES IN STOCHASTIC DYNAMIC PROGRAMMING
- Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
- Bias Optimality for Continuous-Time Controlled Markov Chains
- A First Course in Optimization Theory
- Approaches to the Theory of Optimization
- Constrained Continuous-Time Markov Control Processes with Discounted Criteria
- Approximating Ergodic Average Reward Continuous-Time Controlled Markov Chains
- Drift and monotonicity conditions for continuous-time controlled markov chains with an average criterion
- Ergodic Control of Continuous-Time Markov Chains with Pathwise Constraints
- Markovian Sequential Replacement Processes
- On Finding Optimal Policies in Discrete Dynamic Programming with No Discounting
- Stochastic finance. An introduction in discrete time