Parallel optimized sampling for stochastic equations
From MaRDI portal
Abstract: Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales proportionate to 1/N_S for N_S samples. In this paper, we obtain a new class of variance reduction methods for treating stochastic equations, called parallel optimized sampling. The objective of parallel optimized sampling is to reduce the sampling variance in the observables of an ensemble of stochastic trajectories. This is achieved through calculating a finite set of observables - typically statistical moments - in parallel, and minimizing the errors compared to known values. The algorithm is both numerically efficient and unbiased. Importantly, it does not increase the errors in higher order moments, and generally reduces such errors as well. The same procedure is applied both to initial ensembles and to changes in a finite time-step. Results of these methods show that errors in initially optimized moments can be reduced to the machine precision level, typically around 10^(-16) in current hardware. For nonlinear stochastic equations, sampled moment errors during time-evolution are larger than this, due to error propagation effects. Even so, we provide evidence for error reductions of up to two orders of magnitude in a nonlinear equation example, for low order moments, which is a large practical benefit. The sampling variance typically scales as 1/N_S, but with the advantage of a very much smaller prefactor than for standard, non-optimized methods.
Recommendations
- Algorithms for integration of stochastic differential equations using parallel optimized sampling in the Stratonovich calculus
- Optimization of a Monte Carlo variance reduction method based on sensitivity derivatives
- Parallel simultaneous perturbation optimization
- Stochastic parareal: an application of probabilistic methods to time-parallelization
- Stochastic Parareal: An Application of Probabilistic Methods to Time-Parallelization
Cites work
- scientific article; zbMATH DE number 430390 (Why is no real title available?)
- scientific article; zbMATH DE number 51724 (Why is no real title available?)
- scientific article; zbMATH DE number 54145 (Why is no real title available?)
- scientific article; zbMATH DE number 1999206 (Why is no real title available?)
- A note on the stability properties of the Euler methods for solving stochastic differential equations
- An algorithmic introduction to numerical simulation of stochastic differential equations
- Approximate Integration of Stochastic Differential Equations
- Checking the validity of truncating the cumulant hierarchy description of a small system
- Expansion of the global error for numerical schemes solving stochastic differential equations
- Multilevel Monte Carlo Path Simulation
- Numerical integration of the Langevin equation: Monte Carlo simulation
- Quasi-Monte Carlo integration
- Robust algorithms for solving stochastic partial differential equations
- Stochastic processes in physics and chemistry.
- The Fokker-Planck equation. Methods of solutions and applications.
- The quantum theory of nonlinear optics
Cited in
(5)- scientific article; zbMATH DE number 7561278 (Why is no real title available?)
- Generalized parallel sampling
- Stochastic modelling of diffusion equations on a parallel machine
- Optimization of a Monte Carlo variance reduction method based on sensitivity derivatives
- Algorithms for integration of stochastic differential equations using parallel optimized sampling in the Stratonovich calculus
This page was built for publication: Parallel optimized sampling for stochastic equations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2953226)
