Numerical methods for piecewise deterministic Markov processes with boundary

DOI10.1051/PROC/201445035zbMATH Open1356.60116arXiv1810.10215OpenAlexW2258860009MaRDI QIDQ3465871FDOQ3465871

Authors: Ludovic Goudenège 

Publication date: 29 January 2016

Published in: ESAIM: Proceedings and Surveys (Search for Journal in Brave)

Abstract: In this paper is described the general aspect of a numerical method for piecewise determin-istic Markov processes with boundary. Under very natural hypotheses, a crucial result about uniqueness of solution of a generalized Kolmogorov equation with respect to a test function space is proved. Next we prove the existence and uniqueness of a positive solution to the finite volume scheme without result about convergence. Finally different models of transmission control protocol window-size processes are simulated to illustrate the efficiency of the numerical method for describing the evolution of the density of a piecewise deterministic Markov process with boundary. Obviously some technical aspects have been skipped for reader convenience but the full theory will be exposed in a forthcoming paper in collaboration with C.

Full work available at URL: https://arxiv.org/abs/1810.10215

Recommendations

• Numerical methods for piecewise deterministic Markov processes with boundary
• Numerical method for expectations of piecewise deterministic Markov processes
• Numerical methods for the exit time of a piecewise-deterministic Markov process
• Numerical method for optimal stopping of piecewise deterministic Markov processes
• Numerical experiments for some Markov models for solving boundary value problems
• Almost sure convergence of numerical approximations for piecewise deterministic Markov processes
• Numerical methods for simulation and optimization of piecewise deterministic Markov processes. Application to reliability
• Numerical Methods in Markov Chain Modeling
• Densities for piecewise deterministic Markov processes with boundary

zbMATH Keywords

finite volume schemegeneralized Kolmogorov equationMarkov processes with boundary

Mathematics Subject Classification ID

Numerical analysis or methods applied to Markov chains (65C40) Continuous-time Markov processes on general state spaces (60J25) Finite volume methods for boundary value problems involving PDEs (65N08)

Cites Work

• Qualitative properties of certain piecewise deterministic Markov processes
• Finite volume schemes for the approximation via characteristics of linear convection equations with irregular data

Cited In (7)

• Numerical evaluation of resolvents and Laplace transforms of Markov processes using linear programming
• Analysis Of Upwind Method For Piecewise Deterministic Markov Processes
• Numerical method for expectations of piecewise deterministic Markov processes
• A FINITE DIFFERENCE METHOD FOR PIECEWISE DETERMINISTIC PROCESSES WITH MEMORY. II
• A FINITE DIFFERENCE METHOD FOR PIECEWISE DETERMINISTIC PROCESSES WITH MEMORY
• An implicit finite volume scheme for a scalar hyperbolic problem with measure data related to piecewise deterministic Markov processes
• Numerical methods for piecewise deterministic Markov processes with boundary

This page was built for publication: Numerical methods for piecewise deterministic Markov processes with boundary

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3465871)