Quantifying and Managing Uncertainty in Piecewise-Deterministic Markov Processes
From MaRDI portal
Hamilton-Jacobi PDEsoptimal controlpiecewise-deterministic processrobustnessuncertainty quantification
Hamilton-Jacobi equations (35F21) Initial-boundary value problems for systems of nonlinear first-order PDEs (35F61) Dynamic programming in optimal control and differential games (49L20) Continuous-time Markov processes on discrete state spaces (60J27) Other physical applications of random processes (60K40) Numerical analysis or methods applied to Markov chains (65C40) Finite difference methods for initial value and initial-boundary value problems involving PDEs (65M06)
Abstract: In piecewise-deterministic Markov processes (PDMPs) the state of a finite-dimensional system evolves continuously, but the evolutive equation may change randomly as a result of discrete switches. A running cost is integrated along the corresponding piecewise-deterministic trajectory up to the termination to produce the cumulative cost of the process. We address three natural questions related to uncertainty in cumulative cost of PDMP models: (1) how to compute the Cumulative Distribution Function (CDF) of the cumulative cost when the switching rates are fully known; (2) how to accurately bound the CDF when the switching rates are uncertain; and (3) assuming the PDMP is controlled, how to select a control to optimize that CDF. In all three cases, our approach requires posing a system of suitable hyperbolic partial differential equations, which are then solved numerically on an augmented state space. We illustrate our method using simple examples of trajectory planning under uncertainty for several 1D and 2D first-exit time problems. In the Appendix, we also apply this method to a model of fish harvesting in an environment with random switches in carrying capacity.
Recommendations
- Uncertainty quantification for Markov processes via variational principles and functional inequalities
- Piecewise deterministic Markov processes and their application to risk theory
- Uncertainty quantification for Markov random fields
- Methods for measuring expectations and uncertainty in Markov-switching models
- scientific article; zbMATH DE number 2189773
- Statistical inference for piecewise-deterministic Markov processes
- Piecewise-deterministic Markov processes
- Piecewise deterministic Markov processes for continuous-time Monte Carlo
- Modelling dependence uncertainty in the extremes of Markov chain
Cites work
- \(H^ \infty\)-optimal control and related minimax design problems. A dynamic game approach.
- A dynamic contagion process
- A fast marching level set method for monotonically advancing fronts.
- A multigenerational game model to analyze sustainable development
- A piecewise deterministic model for a prey-predator community
- A stochastic control model of economic growth with environmental disaster prevention
- An efficient method for multiobjective optimal control and optimal control subject to integral constraints
- An optimal control problem with a random stopping time
- An ordered upwind method with precomputed stencil and monotone node acceptance for solving static convex Hamilton-Jacobi equations
- Analysis Of Upwind Method For Piecewise Deterministic Markov Processes
- Approximation of the Pareto optimal set for multiobjective optimal control problems using viability kernels
- Control-theoretic models of environmental crime
- Controlled Markov processes and viscosity solutions
- Deterministic control of randomly-terminated processes
- Efficient fast marching with Finsler metrics
- Fast two-scale methods for eikonal equations
- scientific article; zbMATH DE number 3901778 (Why is no real title available?)
- scientific article; zbMATH DE number 1254171 (Why is no real title available?)
- scientific article; zbMATH DE number 1302036 (Why is no real title available?)
- scientific article; zbMATH DE number 1350741 (Why is no real title available?)
- scientific article; zbMATH DE number 1405863 (Why is no real title available?)
- Lotka-Volterra with randomly fluctuating environments or ``how switching between beneficial environments can make survival harder
- Models of dispersal in biological systems
- Monotone Difference Approximations for Scalar Conservation Laws
- On a predator-prey system with random switching that never converges to its equilibrium
- ON DIFFUSION BY DISCONTINUOUS MOVEMENTS, AND ON THE TELEGRAPH EQUATION
- Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations
- Optimal control of piecewise deterministic markov process
- Optimal control of production rate in a failure prone manufacturing system
- Optimal routing for maximizing the travel time reliability
- Optimality of Zero-Inventory Policies for Unreliable Manufacturing Systems
- Ordered Upwind Methods for Static Hamilton--Jacobi Equations: Theory and Algorithms
- Pareto front characterization for multiobjective optimal control problems using Hamilton-Jacobi approach
- Piecewise deterministic Markov processes applied to fatigue crack growth modelling
- Piecewise deterministic Markov processes in biological models
- Semi-Lagrangian approximation schemes for linear and Hamilton-Jacobi equations
- Simulating the formation of keratin filament networks by a piecewise-deterministic Markov process
- The Diffusion Limit of Transport Equations Derived from Velocity-Jump Processes
- Threshold dynamics and ergodicity of an SIRS epidemic model with Markovian switching
Cited in
(1)
This page was built for publication: Quantifying and Managing Uncertainty in Piecewise-Deterministic Markov Processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6177927)
