Average continuous control of piecewise deterministic Markov processes
From MaRDI portal
Abstract: This paper deals with the long run average continuous control problem of piecewise deterministic Markov processes (PDMP's) taking values in a general Borel space and with compact action space depending on the state variable. The control variable acts on the jump rate and transition measure of the PDMP, and the running and boundary costs are assumed to be positive but not necessarily bounded. Our first main result is to obtain an optimality equation for the long run average cost in terms of a discrete-time optimality equation related to the embedded Markov chain given by the post-jump location of the PDMP. Our second main result guarantees the existence of a feedback measurable selector for the discrete-time optimality equation by establishing a connection between this equation and an integro-differential equation. Our final main result is to obtain some sufficient conditions for the existence of a solution for a discrete-time optimality inequality and an ordinary optimal feedback control for the long run average cost using the so-called vanishing discount approach.
Recommendations
- scientific article; zbMATH DE number 6174821
- The vanishing discount approach for the average continuous control of piecewise deterministic Markov processes
- Optimal control of piecewise deterministic Markov processes
- Piecewise deterministic Markov control processes with feedback controls and unbounded costs
- Hamilton-Jacobi-Bellman inequality for the average control of piecewise deterministic Markov processes
Cited in
(30)- A Fokker-Planck control framework for stochastic systems
- Piecewise deterministic Markov control processes with feedback controls and unbounded costs
- Optimal liquidation under partial information with price impact
- On the vanishing discount factor approach for Markov decision processes with weakly continuous transition probabilities
- Risk-sensitive finite-horizon piecewise deterministic Markov decision processes
- On piecewise linear processes
- Hermite approximation of a hyperbolic Fokker-Planck optimality system to control a piecewise-deterministic process
- Average H 2 control by randomized algorithms
- Optimal control of a class of piecewise deterministic processes
- The vanishing discount approach for the average continuous control of piecewise deterministic Markov processes
- Uniform asymptotics in the average continuous control of piecewise deterministic Markov processes: vanishing approach
- On the Poisson Equation for Piecewise-Deterministic Markov Processes
- Average control of Markov decision processes with Feller transition probabilities and general action spaces
- Optimal control of partially observable piecewise deterministic Markov processes
- A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes
- Continuous average control of piecewise deterministic Markov processes
- scientific article; zbMATH DE number 6174821 (Why is no real title available?)
- Optimal control of piecewise deterministic Markov processes
- Finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates
- Hamilton-Jacobi-Bellman inequality for the average control of piecewise deterministic Markov processes
- Abel-type results for controlled piecewise deterministic Markov processes
- Singular perturbation for the discounted continuous control of piecewise deterministic Markov processes
- Asymptotic control for a class of piecewise deterministic Markov processes associated to temperate viruses
- Approximation methods for piecewise deterministic Markov processes and their costs
- The policy iteration algorithm for average continuous control of piecewise deterministic Markov processes
- Adaptive discounted control for piecewise deterministic Markov processes
- Two-time scale reinforcement learning and applications to production planning
- Adaptive average control for piecewise deterministic Markov processes
- Existence of optimal controls for stochastic Volterra equations
- Closed-loop equilibria for mean-field games in randomly switching environments with general discounting costs
This page was built for publication: Average continuous control of piecewise deterministic Markov processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3083221)
