On the convergence of adaptive sequential Monte Carlo methods
From MaRDI portal
Abstract: In several implementations of Sequential Monte Carlo (SMC) methods it is natural, and important in terms of algorithmic efficiency, to exploit the information of the history of the samples to optimally tune their subsequent propagations. In this article we provide a carefully formulated asymptotic theory for a class of such emph{adaptive} SMC methods. The theoretical framework developed here will cover, under assumptions, several commonly used SMC algorithms. There are only limited results about the theoretical underpinning of such adaptive methods: we will bridge this gap by providing a weak law of large numbers (WLLN) and a central limit theorem (CLT) for some of these algorithms. The latter seems to be the first result of its kind in the literature and provides a formal justification of algorithms used in many real data context. We establish that for a general class of adaptive SMC algorithms the asymptotic variance of the estimators from the adaptive SMC method is emph{identical} to a so-called `perfect' SMC algorithm which uses ideal proposal kernels. Our results are supported by application on a complex high-dimensional posterior distribution associated with the Navier-Stokes model, where adapting high-dimensional parameters of the proposal kernels is critical for the efficiency of the algorithm.
Recommendations
- On adaptive resampling strategies for sequential Monte Carlo methods
- An adaptive sequential Monte Carlo sampler
- Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference
- Limit theorems for weighted samples with applications to sequential Monte Carlo methods
- Limit theorems for weighted samples with applications to sequential Monte Carlo methods
Cites work
- scientific article; zbMATH DE number 5919872 (Why is no real title available?)
- scientific article; zbMATH DE number 2106098 (Why is no real title available?)
- A general theory of particle filters in hidden Markov models and some applications
- A nonasymptotic theorem for unnormalized Feynman-Kac particle models
- A sequential particle filter method for static models
- An adaptive sequential Monte Carlo method for approximate Bayesian computation
- Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference
- Fluctuation analysis of adaptive multilevel splitting
- Inference for Lévy-driven stochastic volatility models via adaptive sequential Monte Carlo
- Limit theorems for weighted samples with applications to sequential Monte Carlo methods
- Long-term stability of sequential Monte Carlo methods under verifiable conditions
- MCMC methods for functions: modifying old algorithms to make them faster
- Mean field simulation for Monte Carlo integration
- On adaptive resampling strategies for sequential Monte Carlo methods
- On the ergodicity properties of some adaptive MCMC algorithms
- On the stability of sequential Monte Carlo methods in high dimensions
- Optimal scalings for local Metropolis-Hastings chains on nonproduct targets in high dimensions
- Sequential Monte Carlo Samplers
- Sequential Monte Carlo methods for high-dimensional inverse problems: a case study for the Navier-Stokes equations
- Sequential Monte Carlo on large binary sampling spaces
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
Cited in
(47)- An Invitation to Sequential Monte Carlo Samplers
- On adaptive resampling strategies for sequential Monte Carlo methods
- Accelerating sequential Monte Carlo with surrogate likelihoods
- Generalized parallel tempering on Bayesian inverse problems
- Limit theorems for weighted samples with applications to sequential Monte Carlo methods
- Simple conditions for convergence of sequential Monte Carlo genealogies with applications
- A langevinized ensemble Kalman filter for large-scale dynamic learning
- On the role of interaction in sequential Monte Carlo algorithms
- Adaptation of the tuning parameter in general Bayesian inference with robust divergence
- Advanced Multilevel Monte Carlo Methods
- Sequential Kalman tuning of the \(t\)-preconditioned Crank-Nicolson algorithm: efficient, adaptive and gradient-free inference for Bayesian inverse problems
- Bayesian estimation of long-run risk models using sequential Monte Carlo
- A practical example for the non-linear Bayesian filtering of model parameters
- A cautionary tale on the efficiency of some adaptive Monte Carlo schemes
- Adaptive tuning of Hamiltonian Monte Carlo within sequential Monte Carlo
- Sequential Monte Carlo samplers with independent Markov chain Monte Carlo proposals
- Sequential Monte Carlo methods for Bayesian elliptic inverse problems
- A fast particle-based approach for calibrating a 3-D model of the Antarctic ice sheet
- An adaptive truncation method for inference in Bayesian nonparametric models
- Monte Carlo algorithms for computing \(\alpha \)-permanents
- Finite-sample complexity of sequential Monte Carlo estimators
- Robust measurement of (heavy-tailed) risks: theory and implementation
- Rare event simulation and splitting for discontinuous random variables
- Biased online parameter inference for state-space models
- The ensemble Kalman filter for rare event estimation
- Multilevel sequential Monte Carlo for Bayesian inverse problems
- Multilevel sequential importance sampling for rare event estimation
- Sequential ensemble transform for Bayesian inverse problems
- Variance estimation in adaptive sequential Monte Carlo
- Vector operations for accelerating expensive Bayesian computations - a tutorial guide
- Adapting the Number of Particles in Sequential Monte Carlo Methods Through an Online Scheme for Convergence Assessment
- Bayesian updating and marginal likelihood estimation by cross entropy based importance sampling
- Bayesian Parameter Identification in Cahn--Hilliard Models for Biological Growth
- scientific article; zbMATH DE number 5722739 (Why is no real title available?)
- Finite sample complexity of sequential Monte Carlo estimators on multimodal target distributions
- The divide-and-conquer sequential Monte Carlo algorithm: theoretical properties and limit theorems
- Analysis of a multilevel Markov chain Monte Carlo finite element method for Bayesian inversion of log-normal diffusions
- Adaptive sequential Monte Carlo by means of mixture of experts
- Subsampling sequential Monte Carlo for static Bayesian models
- Multilevel Monte Carlo in approximate Bayesian computation
- Sequential Monte Carlo Methods in Practice
- On the efficiency of adaptive MCMC algorithms
- Conditions for convergence of Monte Carlo EM sequences with an application to product diffusion modeling
- An adaptive sequential Monte Carlo sampler
- Particle Filtering for Stochastic Navier--Stokes Signal Observed with Linear Additive Noise
- Parallel sequential Monte Carlo samplers and estimation of the number of states in a hidden Markov model
- Controlled sequential Monte Carlo
This page was built for publication: On the convergence of adaptive sequential Monte Carlo methods
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q292923)
