Linearization techniques for controlled piecewise deterministic Markov processes; application to Zubov's method

DOI10.1007/s00245-012-9169-xzbMath1269.93020MaRDI QIDQ2391933

Oana-Silvia Serea, Dan Goreac

Publication date: 5 August 2013

Published in: Applied Mathematics and Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s00245-012-9169-x

zbMATH Keywords

gene networks; viscosity solutions; gene expression; stability domain; stochastic gene networks; linearization techniques; Zubov's method; occupational measure; controlled piecewise deterministic Markov processes (PDMP); Cook's model; Hamilton-Jacobi integral-differential equation; infinite horizon control problems; infinite-dimensional set

Mathematics Subject Classification ID

93B18: Linearizations

49L25: Viscosity solutions to Hamilton-Jacobi equations in optimal control and differential games

93C30: Control/observation systems governed by functional relations other than differential equations (such as hybrid and switching systems)

Related Items

Multiconstrained Finite-Horizon Piecewise Deterministic Markov Decision Processes with Unbounded Transition Rates, Asymptotic Control for a Class of Piecewise Deterministic Markov Processes Associated to Temperate Viruses, Return-to-normality in a piecewise deterministic Markov SIR+V model with pharmaceutical and non-pharmaceutical interventions, Optimality issues for a class of controlled singularly perturbed stochastic systems, A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes, Infection time in multistable gene networks. A backward stochastic variational inequality with nonconvex switch-dependent reflection approach, Abel-type results for controlled piecewise deterministic Markov processes, A piecewise deterministic Markov toy model for traffic/maintenance and associated Hamilton-Jacobi integrodifferential systems on networks, Algebraic invariance conditions in the study of approximate (null-)controllability of Markov switch processes, Reflected dynamics: viscosity analysis for \(\mathbb{L}^\infty\) cost, relaxation and abstract dynamic programming, Constrained and Unconstrained Optimal Discounted Control of Piecewise Deterministic Markov Processes

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Mayer and optimal stopping stochastic control problems with discontinuous cost
• Stochastic optimal control and linear programming approach
• Construction of global Lyapunov functions using radial basis functions
• Asymptotic behavior of dynamical and control systems under perturbation and discretization
• Characterizing attraction probabilities via the stochastic Zubov equation
• A Generalization of Zubov's Method to Perturbed Systems
• A regularization of Zubov’s equation for robust domains of attraction
• Linearization techniques for $\mathbb{L}^{\infty}$-control problems and dynamic programming principles in classical and $\mathbb{L}^{\infty}$-control problems
• Differential Games and Zubov's Method
• STABILIZATION OF CONTROLLED DIFFUSIONS AND ZUBOV'S METHOD
• Linear Programming Approach to Deterministic Infinite Horizon Optimal Control Problems with Discounting
• Control Lyapunov Functions and Zubov's Method
• A Lyapunov-Like Characterization of Asymptotic Controllability
• Optimal Control with State-Space Constraint. II
• On the convergence rate of approximation schemes for Hamilton-Jacobi-Bellman Equations
• Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations