Efficient Sequential Monte-Carlo Samplers for Bayesian Inference
From MaRDI portal
Abstract: In many problems, complex non-Gaussian and/or nonlinear models are required to accurately describe a physical system of interest. In such cases, Monte Carlo algorithms are remarkably flexible and extremely powerful approaches to solve such inference problems. However, in the presence of a high-dimensional and/or multimodal posterior distribution, it is widely documented that standard Monte-Carlo techniques could lead to poor performance. In this paper, the study is focused on a Sequential Monte-Carlo (SMC) sampler framework, a more robust and efficient Monte Carlo algorithm. Although this approach presents many advantages over traditional Monte-Carlo methods, the potential of this emergent technique is however largely underexploited in signal processing. In this work, we aim at proposing some novel strategies that will improve the efficiency and facilitate practical implementation of the SMC sampler specifically for signal processing applications. Firstly, we propose an automatic and adaptive strategy that selects the sequence of distributions within the SMC sampler that minimizes the asymptotic variance of the estimator of the posterior normalization constant. This is critical for performing model selection in modelling applications in Bayesian signal processing. The second original contribution we present improves the global efficiency of the SMC sampler by introducing a novel correction mechanism that allows the use of the particles generated through all the iterations of the algorithm (instead of only particles from the last iteration). This is a significant contribution as it removes the need to discard a large portion of the samples obtained, as is standard in standard SMC methods. This will improve estimation performance in practical settings where computational budget is important to consider.
Recommendations
- Sequential Monte Carlo Samplers
- Sequential Monte Carlo on large binary sampling spaces
- An Invitation to Sequential Monte Carlo Samplers
- An adaptive sequential Monte Carlo method for approximate Bayesian computation
- Bayesian Approaches to the Design of Markov Chain Monte Carlo Samplers
- Subsampling sequential Monte Carlo for static Bayesian models
- Efficient Bernoulli factory Markov chain Monte Carlo for intractable posteriors
- An adaptive sequential Monte Carlo sampler
Cited in
(15)- Finite-sample complexity of sequential Monte Carlo estimators
- Sequential estimation of temporally evolving latent space network models
- An Invitation to Sequential Monte Carlo Samplers
- The stochastic collocation Monte Carlo sampler: highly efficient sampling from ‘expensive’ distributions
- Sequential ensemble transform for Bayesian inverse problems
- Sequential Monte Carlo with Highly Informative Observations
- Cost free hyper-parameter selection/averaging for Bayesian inverse problems with vanilla and Rao-blackwellized SMC samplers
- Sequential Monte Carlo samplers to fit and compare insurance loss models
- scientific article; zbMATH DE number 6378055 (Why is no real title available?)
- A novel system identification algorithm for nonlinear Markov jump system
- Sequential Monte Carlo samplers with independent Markov chain Monte Carlo proposals
- Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator
- Sequential Monte Carlo Samplers: Error Bounds and Insensitivity to Initial Conditions
- Likelihood level adapted estimation of marginal likelihood for Bayesian model selection
- Bayesian Approaches to the Design of Markov Chain Monte Carlo Samplers
This page was built for publication: Efficient Sequential Monte-Carlo Samplers for Bayesian Inference
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4618233)
