On the convergence of adaptive sequential Monte Carlo methods
From MaRDI portal
Abstract: In several implementations of Sequential Monte Carlo (SMC) methods it is natural, and important in terms of algorithmic efficiency, to exploit the information of the history of the samples to optimally tune their subsequent propagations. In this article we provide a carefully formulated asymptotic theory for a class of such emph{adaptive} SMC methods. The theoretical framework developed here will cover, under assumptions, several commonly used SMC algorithms. There are only limited results about the theoretical underpinning of such adaptive methods: we will bridge this gap by providing a weak law of large numbers (WLLN) and a central limit theorem (CLT) for some of these algorithms. The latter seems to be the first result of its kind in the literature and provides a formal justification of algorithms used in many real data context. We establish that for a general class of adaptive SMC algorithms the asymptotic variance of the estimators from the adaptive SMC method is emph{identical} to a so-called `perfect' SMC algorithm which uses ideal proposal kernels. Our results are supported by application on a complex high-dimensional posterior distribution associated with the Navier-Stokes model, where adapting high-dimensional parameters of the proposal kernels is critical for the efficiency of the algorithm.
Recommendations
- On adaptive resampling strategies for sequential Monte Carlo methods
- An adaptive sequential Monte Carlo sampler
- Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference
- Limit theorems for weighted samples with applications to sequential Monte Carlo methods
- Limit theorems for weighted samples with applications to sequential Monte Carlo methods
Cites work
- scientific article; zbMATH DE number 5919872 (Why is no real title available?)
- scientific article; zbMATH DE number 2106098 (Why is no real title available?)
- A general theory of particle filters in hidden Markov models and some applications
- A nonasymptotic theorem for unnormalized Feynman-Kac particle models
- A sequential particle filter method for static models
- An adaptive sequential Monte Carlo method for approximate Bayesian computation
- Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference
- Fluctuation analysis of adaptive multilevel splitting
- Inference for Lévy-driven stochastic volatility models via adaptive sequential Monte Carlo
- Limit theorems for weighted samples with applications to sequential Monte Carlo methods
- Long-term stability of sequential Monte Carlo methods under verifiable conditions
- MCMC methods for functions: modifying old algorithms to make them faster
- Mean field simulation for Monte Carlo integration
- On adaptive resampling strategies for sequential Monte Carlo methods
- On the ergodicity properties of some adaptive MCMC algorithms
- On the stability of sequential Monte Carlo methods in high dimensions
- Optimal scalings for local Metropolis-Hastings chains on nonproduct targets in high dimensions
- Sequential Monte Carlo Samplers
- Sequential Monte Carlo methods for high-dimensional inverse problems: a case study for the Navier-Stokes equations
- Sequential Monte Carlo on large binary sampling spaces
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
Cited in
(51)- Persistent sampling: enhancing the efficiency of sequential Monte Carlo
- Finite sample complexity of sequential Monte Carlo estimators on multimodal target distributions
- The divide-and-conquer sequential Monte Carlo algorithm: theoretical properties and limit theorems
- Limit theorems for weighted samples with applications to sequential Monte Carlo methods
- A langevinized ensemble Kalman filter for large-scale dynamic learning
- Finite-sample complexity of sequential Monte Carlo estimators
- Bayesian updating and marginal likelihood estimation by cross entropy based importance sampling
- An Invitation to Sequential Monte Carlo Samplers
- Bayesian estimation of long-run risk models using sequential Monte Carlo
- An adaptive sequential Monte Carlo sampler
- Sequential Monte Carlo Methods in Practice
- Adapting the Number of Particles in Sequential Monte Carlo Methods Through an Online Scheme for Convergence Assessment
- Vector operations for accelerating expensive Bayesian computations - a tutorial guide
- Sequential ensemble transform for Bayesian inverse problems
- Variance estimation in adaptive sequential Monte Carlo
- Analysis of a multilevel Markov chain Monte Carlo finite element method for Bayesian inversion of log-normal diffusions
- Multilevel sequential Monte Carlo for Bayesian inverse problems
- On adaptive resampling strategies for sequential Monte Carlo methods
- On the role of interaction in sequential Monte Carlo algorithms
- Controlled sequential Monte Carlo
- Bayesian Parameter Identification in Cahn--Hilliard Models for Biological Growth
- A cautionary tale on the efficiency of some adaptive Monte Carlo schemes
- scientific article; zbMATH DE number 5722739 (Why is no real title available?)
- Subsampling sequential Monte Carlo for static Bayesian models
- Adaptive tuning of Hamiltonian Monte Carlo within sequential Monte Carlo
- Parallel sequential Monte Carlo samplers and estimation of the number of states in a hidden Markov model
- Doubly Adaptive Importance Sampling
- Simple conditions for convergence of sequential Monte Carlo genealogies with applications
- The ensemble Kalman filter for rare event estimation
- Robust measurement of (heavy-tailed) risks: theory and implementation
- Adaptive sequential Monte Carlo by means of mixture of experts
- A practical example for the non-linear Bayesian filtering of model parameters
- Conditions for convergence of Monte Carlo EM sequences with an application to product diffusion modeling
- Adaptation of the tuning parameter in general Bayesian inference with robust divergence
- Accelerating sequential Monte Carlo with surrogate likelihoods
- Generalized parallel tempering on Bayesian inverse problems
- Adaptive reduced tempering for Bayesian inverse problems and rare event simulation
- Sequential Monte Carlo methods for Bayesian elliptic inverse problems
- Sequential Monte Carlo samplers with independent Markov chain Monte Carlo proposals
- Sequential Kalman tuning of the t-preconditioned Crank-Nicolson algorithm: efficient, adaptive and gradient-free inference for Bayesian inverse problems
- Rare event simulation and splitting for discontinuous random variables
- Multilevel sequential importance sampling for rare event estimation
- Monte Carlo algorithms for computing \(\alpha \)-permanents
- Unbiased and consistent nested sampling via sequential Monte Carlo
- An adaptive truncation method for inference in Bayesian nonparametric models
- Particle Filtering for Stochastic Navier--Stokes Signal Observed with Linear Additive Noise
- Advanced Multilevel Monte Carlo Methods
- On the efficiency of adaptive MCMC algorithms
- A fast particle-based approach for calibrating a 3-D model of the Antarctic ice sheet
- Multilevel Monte Carlo in approximate Bayesian computation
- Biased online parameter inference for state-space models
This page was built for publication: On the convergence of adaptive sequential Monte Carlo methods
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q292923)
