Learning-based importance sampling via stochastic optimal control for stochastic reaction networks
From MaRDI portal
(Redirected from Publication:6172912)
Abstract: We explore efficient estimation of statistical quantities, particularly rare event probabilities, for stochastic reaction networks. Consequently, we propose an importance sampling (IS) approach to improve the Monte Carlo (MC) estimator efficiency based on an approximate tau-leap scheme. The crucial step in the IS framework is choosing an appropriate change of probability measure to achieve substantial variance reduction. This task is typically challenging and often requires insights into the underlying problem. Therefore, we propose an automated approach to obtain a highly efficient path-dependent measure change based on an original connection in the stochastic reaction network context between finding optimal IS parameters within a class of probability measures and a stochastic optimal control formulation. Optimal IS parameters are obtained by solving a variance minimization problem. First, we derive an associated dynamic programming equation. Analytically solving this backward equation is challenging, hence we propose an approximate dynamic programming formulation to find near-optimal control parameters. To mitigate the curse of dimensionality, we propose a learning-based method to approximate the value function using a neural network, where the parameters are determined via a stochastic optimization algorithm. Our analysis and numerical experiments verify that the proposed learning-based IS approach substantially reduces MC estimator variance, resulting in a lower computational complexity in the rare event regime, compared with standard tau-leap MC estimators.
Recommendations
- Importance sampling for a robust and efficient multilevel Monte Carlo estimator for stochastic reaction networks
- scientific article; zbMATH DE number 5010659
- Stochastic optimal control via forward and backward stochastic differential equations and importance sampling
- Control variates for stochastic simulation of chemical reaction networks
- Adaptive importance sampling for control and inference
- Model reduction algorithms for optimal control and importance sampling of diffusions
- Stochastic chemical reaction networks for robustly approximating arbitrary probability distributions
- Transport map accelerated adaptive importance sampling, and application to inverse problems arising from multiscale stochastic reaction networks
- Variance reduction in stochastic reaction networks using control variates
- Applications of the cross-entropy method to importance sampling and optimal control of diffusions
Cites work
- A multilevel adaptive reaction-splitting simulation method for stochastic reaction networks
- A sparse Markov chain approximation of LQ-type stochastic control problems.
- Adaptive importance sampling with forward-backward stochastic differential equations
- An efficient forward-reverse expectation-maximization algorithm for statistical inference in stochastic reaction networks
- Analysis of Explicit Tau-Leaping Schemes for Simulating Chemically Reacting Systems
- Applications of the cross-entropy method to importance sampling and optimal control of diffusions
- Chebyshev methods with discrete noise: the -rock methods
- Controlled Markov processes and viscosity solutions
- Data-driven method for efficient characterization of rare event probabilities in biochemical systems
- Efficient importance sampling for large sums of independent and identically distributed random variables
- Handbook of Monte Carlo Methods
- scientific article; zbMATH DE number 3951715 (Why is no real title available?)
- IMPLICIT SIMULATION METHODS FOR STOCHASTIC CHEMICAL KINETICS
- Importance sampling for a robust and efficient multilevel Monte Carlo estimator for stochastic reaction networks
- Importance sampling for multiscale diffusions
- Importance sampling in path space for diffusion processes with slow-fast variables
- Markov state models for rare events in molecular dynamics
- Mathematical models in population biology and epidemiology
- Moment growth bounds on continuous time Markov processes on non-negative integer lattices
- Multilevel hybrid split-step implicit tau-leap
- Multilevel Monte Carlo for continuous time Markov chains, with applications in biochemical kinetics
- Multilevel Monte Carlo Path Simulation
- Note: On the Interchange of Derivative and Expectation for Likelihood Ratio Derivative Estimators
- Reversible-equivalent-monomolecular tau: a leaping method for ``small number and stiff stochastic chemical systems
- Solving high-dimensional Hamilton-Jacobi-Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path space
- Stochastic analysis of biochemical systems
- Stochastic kinetic modeling of vesicular stomatitis virus intracellular growth
- Variational approach to rare event simulation using least-squares regression
Cited in
(8)- Importance sampling for a robust and efficient multilevel Monte Carlo estimator for stochastic reaction networks
- Control variates for stochastic simulation of chemical reaction networks
- scientific article; zbMATH DE number 5010659 (Why is no real title available?)
- Variance reduction in stochastic reaction networks using control variates
- Automated importance sampling via optimal control for stochastic reaction networks: a Markovian projection-based approach
- Double-loop importance sampling for McKean-Vlasov stochastic differential equation
- Multilevel importance sampling for rare events associated with the McKean-Vlasov equation
- Importance sampling for rare event tracking within the ensemble Kalman filtering framework
This page was built for publication: Learning-based importance sampling via stochastic optimal control for stochastic reaction networks
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6172912)
