Bellman inequalities in markov decision deterministic drift processes

DOI10.1080/17442508708833481MaRDI QIDQ3786304zbMATH OpenOpenAlexFDO

Authors Alexander A. Yushkevich

Publication date 1987

Published in Stochastics (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1080/17442508708833481

zbMATH Keywords

quasi-variational inequalitiesBellman inequalitiesMarkov decision deterministic drift processes\(\epsilon \)- optimal policiesBellman optimality equationrandomly split time parameter

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40)

Recommendations

• Verification Theorems for Markov Decision Processes with Controlled Deterministic Drift and Gradual and Impulsive Controls
• scientific article; zbMATH DE number 3956845
• Uniqueness of the solution of Bellman's equation in the case of general controlled processes
• Vector-valued Markov decision processes and the systems of linear inequalities
• Markov Decision Drift Processes; Conditions for Optimality Obtained by Discretization

Cites work

• scientific article; zbMATH DE number 3823489 (Why is no real title available?)
• scientific article; zbMATH DE number 3390061 (Why is no real title available?)
• Continuous time markov decision processes with interventions
• Markov Decision Drift Processes; Conditions for Optimality Obtained by Discretization
• Negative Dynamic Programming
• Probability methods for approximations in stochastic control and for elliptic equations
• Stochastic optimal control. The discrete time case

Cited in

(17)

• Multiconstrained finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates
• Impulse control of piecewise-deterministic processes
• Hamilton-Jacobi-Bellman inequality for the average control of piecewise deterministic Markov processes
• Factorization, basic notions and applications
• Optimal control of semi-Markov processes with a backward stochastic differential equations approach
• Gradual-Impulsive Control for Continuous-Time Markov Decision Processes with Total Undiscounted Costs and Constraints: Linear Programming Approach via a Reduction Method
• On reducing a constrained gradual-impulsive control problem for a jump Markov model to a model with gradual control only
• On piecewise deterministic Markov control processes: Control of jumps and of risk processes in insurance
• Some ideas for comparison of Bellman chains.
• Finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates
• Constrained and unconstrained optimal discounted control of piecewise deterministic Markov processes
• Impulsive Control for Continuous-Time Markov Decision Processes
• Impulsive control for continuous-time Markov decision processes: a linear programming approach
• Optimal control of piecewise deterministic Markov processes
• scientific article; zbMATH DE number 744071 (Why is no real title available?)
• Verification Theorems for Markov Decision Processes with Controlled Deterministic Drift and Gradual and Impulsive Controls
• On gradual-impulse control of continuous-time Markov decision processes with exponential utility

This page was built for publication: Bellman inequalities in markov decision deterministic drift processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3786304)