Applications of some formulas for finite Markov chains
The authors describe how some elementary computations with finite state Markov chain transition matrices lead to interesting and promising applications. The computations and sample applications are based on two observations. The first one is that the product of the transition matrix interlaced with projections on states of interest gives probabilities along corresponding subsets of paths. The scond observation is a discrete version of the Feynman-Kac formula. Finally four applications are presented. In one of these applications the two observations are combined to yield an effective computational method for evaluating the expected value (over paths) of a function of the sum of path attributes; each path starts at a specific point within a subset of states, and ends when the path exits the given subset for the first time. At the same time they describe some sample problems for which their methods may be of use. The authors propose, in another application, a variant of the occasionally used approach to calculate solutions to a large class of Dirichlet-Poisson boundary value problems via diffusion. The proposed method finds the exact solution for each discretization of the continuous boundary value problem. It is emphasized that the existing stochastic methods of which they are aware rely on Monte Carlo simulations and thus require a large number of trials to achieve good accuracy.
- EMBEDDED MATRICES FOR FINITE MARKOV CHAINS
- The basic theory of finite element probability computing methods
- Explicit transient probabilities of various Markov models
- SERIES EXPANSIONS FOR FINITE-STATE MARKOV CHAINS
- Computer aided solving the high-order transition probability matrix of the finite Markov chain
- A Feynman-Kac path-integral implementation for Poisson's equation using an h-conditioned Green's function
- Diffusion wavelets
- Generalized inverses and their application to applied probability problems
- scientific article; zbMATH DE number 1728370 (Why is no real title available?)
- scientific article; zbMATH DE number 3145626 (Why is no real title available?)
- scientific article; zbMATH DE number 53571 (Why is no real title available?)
- scientific article; zbMATH DE number 3069511 (Why is no real title available?)
- Integration in Functional Spaces and its Applications in Quantum Physics
- Kac's moment formula and the Feynman-Kac formula for additive functionals of a Markov process
- Numerical methods for linear boundary value problems based on Feynman-Kac representations
- On Distributions of Certain Wiener Functionals
- On Occupation Times for Markoff Processes
- On the moments of Markov renewal processes
- Solving boundary value problems with complex parameters by the Monte Carlo method
- Space-time approach to non-relativistic quantum mechanics
- Stochastic methods for Dirichlet problems
- The Simplest Random Walks for the Dirichlet Problem
- Some remarks on diffusion distances
- Occurrence probabilities of stochastic paths.
- scientific article; zbMATH DE number 3854137 (Why is no real title available?)
- Some asymptotic formulas for markov chains with applications to simulation†
- scientific article; zbMATH DE number 1069282 (Why is no real title available?)
- Explicit transient probabilities of various Markov models
- Mean first passage costs, the fixed-point cost, and applications to heat kernel diffusion
This page was built for publication: Applications of some formulas for finite Markov chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q617702)
