Steady-state sensitivity analysis of continuous time Markov chains
From MaRDI portal
Abstract: In this paper we study Monte Carlo estimators based on the likelihood ratio approach for steady-state sensitivity. We first extend the result of Glynn and Olvera-Cravioto [doi:doi: 10.1287/stsy.2018.002] to the setting of continuous time Markov chains with a countable state space which include models such as stochastic reaction kinetics and kinetic Monte Carlo lattice system. We show that the variance of the centered likelihood ratio estimators does not grow in time. This result suggests that the centered likelihood ratio estimators should be favored for sensitivity analysis when the mixing time of the underlying continuous time Markov chain is large, which is typically the case when systems exhibit multi-scale behavior. We demonstrate a practical implication of this analysis on a numerical benchmark of two examples for the biochemical reaction networks.
Recommendations
- An efficient finite difference method for parameter sensitivities of continuous time Markov chains
- Improvements in the likelihood ratio method for steady-state sensitivity analysis and simulation
- Likelihood ratio gradient estimation for steady-state parameters
- scientific article; zbMATH DE number 4038959
- Sensitivity of Steady States in Networks with Application to Markov Chains and Chemical Reaction Networks
Cites work
- scientific article; zbMATH DE number 3951715 (Why is no real title available?)
- scientific article; zbMATH DE number 50675 (Why is no real title available?)
- scientific article; zbMATH DE number 1515832 (Why is no real title available?)
- scientific article; zbMATH DE number 3274494 (Why is no real title available?)
- A Liapounov bound for solutions of the Poisson equation
- An efficient finite difference method for parameter sensitivities of continuous time Markov chains
- Computational identification of irreducible state-spaces for stochastic reaction networks
- Efficiency of the Girsanov transformation approach for parametric sensitivity analysis of stochastic chemical kinetics
- Efficient stochastic sensitivity analysis of discrete event systems
- Martingale Transforms
- On the integrability of the martingale square function
- Perturbation analysis for continuous-time Markov chains
- Point processes and queues. Martingale dynamics
- Proofs of the martingale FCLT
- Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
- Stochastic simulation: Algorithms and analysis
- Strongly Consistent Steady-State Derivative Estimates
- Uniform approximations for the \(M/G/1\) queue with subexponential processing times
- Weak limit theorems for stochastic integrals and stochastic differential equations
Cited in
(10)- Convergence of the likelihood ratio method for linear response of non-equilibrium stationary states
- Observable augmented systems for sensitivity analysis of Markov and semi-Markov processes
- Pathwise sensitivity analysis in transient regimes
- scientific article; zbMATH DE number 6520784 (Why is no real title available?)
- Sensitivity analysis for Markov reward structures until entrance times
- Martingale product estimators for sensitivity analysis in computational statistical physics
- An efficient finite difference method for parameter sensitivities of continuous time Markov chains
- An approach to obtaining perturbation bounds for continuous-time Markov chains
- Sensitivity of Steady States in Networks with Application to Markov Chains and Chemical Reaction Networks
- Efficient Steady State Analysis of Multimodal Markov Chains
This page was built for publication: Steady-state sensitivity analysis of continuous time Markov chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4620320)
