scientific article; zbMATH DE number 1348599

MaRDI QIDQ4264741zbMATH OpenFDO

Authors Eitan Altman

Publication date 6 October 1999

zbMATH Keywords

action constrainedconstrained problemscountable statediscrete time Markov decision processesfinite stateinfinite state constrained

Mathematics Subject Classification ID

Introductory exposition (textbooks, tutorial papers, etc.) pertaining to operations research and mathematical programming (90-01) Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming (90-02) Markov and semi-Markov decision processes (90C40) Optimal stochastic control (93E20)

Recommendations

• Constrained Discounted Dynamic Programming
• scientific article; zbMATH DE number 700091
• Constrained Markovian decision processes: The dynamic programming approach

Cited in

(only showing first 100 items - show all)

• Drift control of international reserves
• Resource-constrained management of heterogeneous assets with stochastic deterioration
• Sensitivity of constrained Markov decision processes
• The Lagrange approach to infinite linear programs
• Non-homogeneous Markov decision processes with a constraint
• An optimization approach to multiple sequence alignment
• Multiple objective nonatomic Markov decision processes with total reward criteria
• Bounded-parameter Markov decision processes
• Constrained Markovian decision processes: The dynamic programming approach
• Optimal channel choice for lossy data flow transmission
• Sustainable social choice under risk
• Acceptable strategy profiles in stochastic games
• A characterization of stationary Nash equilibria of constrained stochastic games with independent state processes
• Variance-constrained actor-critic algorithms for discounted and average reward MDPs
• Approachability in Stackelberg stochastic games with vector costs
• Analysis of averages over distributions of Markov processes
• Delay-aware online service scheduling in high-speed railway communication systems
• Markov decision processes with sequential sensor measurements
• Control of \(M|M|1|N\) queue parameters under constraints
• The modified stochastic game
• Singularly perturbed linear programs and Markov decision processes
• Nonatomic total rewards Markov decision processes with multiple criteria
• A mean-variance optimization problem for discounted Markov decision processes
• Lost-sales inventory systems with a service level criterion
• Analysis of transient queues with semidefinite optimization
• Optimal balanced control for call centers
• Markov chains, Hamiltonian cycles and volumes of convex bodies
• Structural properties of the optimal resource allocation policy for single-queue systems
• Modeling and optimization of M/G/1-type queueing networks: an efficient sensitivity analysis approach
• Light robustness in the optimization of Markov decision processes with uncertain parameters
• Front-office multitasking between service encounters and back-office tasks
• Efficiency fairness tradeoff in battery sharing
• Challenges of real-world reinforcement learning: definitions, benchmarks and analysis
• Reinforcement learning: an industrial perspective
• Operational optimization of wastewater treatment plants: a CMDP based decomposition approach
• Whittle index based Q-learning for restless bandits with average reward
• SAMBA: safe model-based \& active reinforcement learning
• Constrained discounted stochastic games
• Co-design of safe and efficient networked control systems in factory automation with state-dependent wireless fading channels
• Constrained discounted Markov decision processes with Borel state spaces
• Convergence of Markov decision processes with constraints and state-action dependent discount factors
• Stochastic approximations of constrained discounted Markov decision processes
• First passage Markov decision processes with constraints and varying discount factors
• Algorithmic aspects of mean-variance optimization in Markov decision processes
• Constrained continuous-time Markov decision processes on the finite horizon
• Reduction of total-cost and average-cost MDPs with weakly continuous transition probabilities to discounted mdps
• Finding the \(K\) best policies in a finite-horizon Markov decision process
• Exact finite approximations of average-cost countable Markov decision processes
• Markov decision processes with their applications
• Markov control processes with randomized discounted cost
• NP-hardness of checking the unichain condition in average cost MDPs
• Discrete-time drift counteraction stochastic optimal control: theory and application-motivated examples
• Constrained continuous-time Markov decision processes with average criteria
• Sample path optimality for a Markov optimization problem
• Discounted Markov decision processes with utility constraints
• An actor-critic algorithm for constrained Markov decision processes
• On constrained Markov decision processes
• Dynamic power control in a fading downlink channel subject to an energy constraint
• Aggregated occupation measures and linear programming approach to constrained impulse control problems
• Optimal control of a queue under a quality-of-service constraint with bounded and unbounded rates
• Remote state estimation with usage-dependent Markovian packet losses
• Reinforcement learning control of constrained dynamic systems with uniformly ultimate boundedness stability guarantee
• A Markov decision process model on dynamic routing for target surveillance
• Constrained Markov decision processes with uncertain costs
• On approximate and weak correlated equilibria in constrained discounted stochastic games
• Absorbing continuous-time Markov decision processes with total cost criteria
• The expected total cost criterion for Markov decision processes under constraints
• Control of continuous-time Markov chains with safety constraints
• Nonzero-sum constrained discrete-time Markov games: the case of unbounded costs
• Markov reward models and Markov decision processes in discrete and continuous time: performance evaluation and optimization
• Markov decision processes with iterated coherent risk measures
• Convergence of controlled models and finite-state approximation for discounted continuous-time Markov decision processes with constraints
• Multiobjective stopping problem for discrete-time Markov processes: convex analytic approach
• Performance bounds and suboptimal policies for linear stochastic control via LMIs
• On the reduction of total-cost and average-cost MDPs to discounted mdps
• Markov Decision Processes with Asymptotic Average Failure Rate Constraint
• The expected total cost criterion for Markov decision processes under constraints: a convex analytic approach
• Circumventing the Slater conundrum in countably infinite linear programs
• An application-oriented approach to dual control with excitation for closed-loop identification
• An overview for Markov decision processes in queues and networks
• scientific article; zbMATH DE number 3852821 (Why is no real title available?)
• scientific article; zbMATH DE number 3891132 (Why is no real title available?)
• A model for equilibrium in some service-provider user-set interactions
• Trading performance for stability in Markov decision processes
• Bio-inspired paradigms in network engineering games
• Convex analytic approach to constrained discounted Markov decision processes with non-constant discount factors
• Optimal Call Admission Control for an IEEE 802.16 Wireless Metropolitan Area Network
• A stochastic game approach for competition over popularity in social networks
• VARIANCE CONSTRAINED MARKOV DECISION PROCESS
• The multi-armed bandit, with constraints
• Derman's book as inspiration: some results on LP for MDPs
• Markov decision processes with state-dependent discount factors and unbounded rewards/costs
• A framework and a mean-field algorithm for the local control of spatial processes
• An online actor-critic algorithm with function approximation for constrained Markov decision processes
• Average control of Markov decision processes with Feller transition probabilities and general action spaces
• Non-ergodic Markov decision processes with a constraint on the asymptotic failure rate: general class of policies
• scientific article; zbMATH DE number 1786122 (Why is no real title available?)
• Risk-constrained reinforcement learning with percentile risk criteria
• A constrained optimization problem with applications to constrained MDPs
• Realizable strategies in continuous-time Markov decision processes

This page was built for publication:

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4264741)