The stochastic reach-avoid problem and set characterization for diffusions
From MaRDI portal
(Redirected from Publication:290823)
dynamic programmingpartial differential equationsreachabilitystochastic controldiscontinuous viscosity solutions
Dynamic programming in optimal control and differential games (49L20) Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games (49L25) Attainable sets, reachability (93B03) Control/observation systems governed by partial differential equations (93C20) Optimal stochastic control (93E20)
Abstract: In this article we approach a class of stochastic reachability problems with state constraints from an optimal control perspective. Preceding approaches to solving these reachability problems are either confined to the deterministic setting or address almost-sure stochastic requirements. In contrast, we propose a methodology to tackle problems with less stringent requirements than almost sure. To this end, we first establish a connection between two distinct stochastic reach-avoid problems and three classes of stochastic optimal control problems involving discontinuous payoff functions. Subsequently, we focus on solutions of one of the classes of stochastic optimal control problems---the exit-time problem, which solves both the two reach-avoid problems mentioned above. We then derive a weak version of a dynamic programming principle (DPP) for the corresponding value function; in this direction our contribution compared to the existing literature is to develop techniques that admit discontinuous payoff functions. Moreover, based on our DPP, we provide an alternative characterization of the value function as a solution of a partial differential equation in the sense of discontinuous viscosity solutions, along with boundary conditions both in Dirichlet and viscosity senses. Theoretical justifications are also discussed to pave the way for deployment of off-the-shelf PDE solvers for numerical computations. Finally, we validate the performance of the proposed framework on the stochastic Zermelo navigation problem.
Recommendations
- Probabilistic Reach-Avoid Computation for Partially Degenerate Stochastic Processes
- scientific article; zbMATH DE number 2134070
- A stochastic reach-avoid problem with random obstacles
- scientific article; zbMATH DE number 4197829
- Diffusive limit approximation of pure-jump optimal stochastic control problems
- On diffusions that cannot escape from a convex set
- Sets of accessibility for controlled stochastic differential equations
- scientific article; zbMATH DE number 4183323
- A stochastic approximation method for reachability computations
- Setwise convergence of solution measures of stochastic differential equations
Cites work
- scientific article; zbMATH DE number 3951715 (Why is no real title available?)
- scientific article; zbMATH DE number 8367 (Why is no real title available?)
- scientific article; zbMATH DE number 19122 (Why is no real title available?)
- scientific article; zbMATH DE number 51724 (Why is no real title available?)
- scientific article; zbMATH DE number 1254167 (Why is no real title available?)
- scientific article; zbMATH DE number 2006037 (Why is no real title available?)
- scientific article; zbMATH DE number 1908207 (Why is no real title available?)
- scientific article; zbMATH DE number 3232606 (Why is no real title available?)
- A Differential Game with Two Players and One Target
- A geometric characterization of viable sets for controlled degenerate diffusions
- Controlled Markov processes and viscosity solutions
- Controlled diffusion processes
- Controlled diffusion processes. Translated by A. B. Aries
- Diffusions and Elliptic Operators
- Dynamic programming for stochastic target problems and geometric flows
- Existence of stochastic control under state constraints
- Foundations of Modern Probability
- Hybrid Systems: Computation and Control
- Invariance of stochastic control systems with deterministic arguments
- Maximizing the probability of attaining a target prior to extinction
- On reachability and minimum cost optimal control
- On the Existence of Pure and Mixed Strategy Nash Equilibria in Discontinuous Games
- Optimal stochastic control, stochastic target problems, and backward SDE.
- Optimal times for constrained nonlinear control problems without local controllability
- Stochastic Target Problems, Dynamic Programming, and Viscosity Solutions
- Stochastic invariance for differential inclusions
- Stochastic target problems with controlled loss
- Stochastic viability for compact sets in terms of the distance function
- The stochastic reach-avoid problem and set characterization for diffusions
- The viability theorem for stochastic differential inclusions2
- User’s guide to viscosity solutions of second order partial differential equations
- Weak dynamic programming principle for viscosity solutions
Cited in
(10)- A stochastic reach-avoid problem with random obstacles
- The stochastic reach-avoid problem and set characterization for diffusions
- Applications of stochastic modeling in air traffic management: methods, challenges and opportunities for solving air traffic problems under uncertainty
- A neural network-based policy iteration algorithm with global \(H^2\)-superlinear convergence for stochastic games on domains
- Time-extremal navigation in arbitrary winds on conformally flat Riemannian manifolds
- Hybrid controller synthesis for nonlinear systems subject to reach-avoid constraints
- From infinite to finite programs: explicit error bounds with applications to approximate dynamic programming
- Recursively feasible stochastic model predictive control using indirect feedback
- Automated verification and synthesis of stochastic hybrid systems: a survey
- Randers metrics based on deformations by gradient winds
This page was built for publication: The stochastic reach-avoid problem and set characterization for diffusions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q290823)
