Sequential Monte Carlo with Highly Informative Observations
From MaRDI portal
Abstract: We propose sequential Monte Carlo (SMC) methods for sampling the posterior distribution of state-space models under highly informative observation regimes, a situation in which standard SMC methods can perform poorly. A special case is simulating bridges between given initial and final values. The basic idea is to introduce a schedule of intermediate weighting and resampling times between observation times, which guide particles towards the final state. This can always be done for continuous-time models, and may be done for discrete-time models under sparse observation regimes; our main focus is on continuous-time diffusion processes. The methods are broadly applicable in that they support multivariate models with partial observation, do not require simulation of the backward transition (which is often unavailable), and, where possible, avoid pointwise evaluation of the forward transition. When simulating bridges, the last cannot be avoided entirely without concessions, and we suggest an epsilon-ball approach (reminiscent of Approximate Bayesian Computation) as a workaround. Compared to the bootstrap particle filter, the new methods deliver substantially reduced mean squared error in normalising constant estimates, even after accounting for execution time. The methods are demonstrated for state estimation with two toy examples, and for parameter estimation (within a particle marginal Metropolis--Hastings sampler) with three applied examples in econometrics, epidemiology and marine biogeochemistry.
Recommendations
- Sequential Monte Carlo methods
- Conditional sequential Monte Carlo in high dimensions
- scientific article; zbMATH DE number 5007617
- Sequential Monte Carlo Samplers
- Efficient Sequential Monte-Carlo Samplers for Bayesian Inference
- Sequentially interacting Markov chain Monte Carlo methods
- Sequentially constrained Monte Carlo
- Sequential Monte Carlo for rare event estimation
- Sequential Monte Carlo for Bayesian sequentially designed experiments for discrete data
- An introduction to sequential Monte Carlo
Cites work
- scientific article; zbMATH DE number 54145 (Why is no real title available?)
- scientific article; zbMATH DE number 2106098 (Why is no real title available?)
- scientific article; zbMATH DE number 758455 (Why is no real title available?)
- A new algorithm for optimization
- Adaptive approximate Bayesian computation
- An adaptive sequential Monte Carlo method for approximate Bayesian computation
- Blind Deconvolution via Sequential Imputations
- Exact and Computationally Efficient Likelihood-Based Estimation for Discretely Observed Diffusion Processes (with Discussion)
- Filtering via Simulation: Auxiliary Particle Filters
- Genealogical particle analysis of rare events
- Guided proposals for simulating multi-dimensional diffusion bridges
- Infectious disease models with time-varying parameters and general nonlinear incidence rate
- Likelihood Inference for Discretely Observed Nonlinear Diffusions
- Lookahead strategies for sequential Monte Carlo
- On disturbance state-space models and the particle marginal Metropolis-Hastings sampler
- On generating Monte Carlo samples of continuous diffusion bridges
- On inference for partially observed nonlinear diffusion models using the Metropolis-Hastings algorithm
- On parameter estimation in population models. II: Multi-dimensional processes and transient dynamics
- On sequential Monte Carlo, partial rejection control and approximate Bayesian computation
- Particle Filters for Partially Observed Diffusions
- Particle Markov chain Monte Carlo for efficient numerical simulation
- Random-Weight Particle Filtering of Continuous Time Processes
- Sequential Monte Carlo without likelihoods
- Simulation of conditioned diffusion and application to parameter estimation
- Simulation of forward-reverse stochastic representations for conditional diffusions
- Solving Ordinary Differential Equations I
- Stochastic processes in physics and chemistry.
- \(\mathrm{SMC}^2\): an efficient algorithm for sequential analysis of state space models
Cited in
(27)- On generating Monte Carlo samples of continuous diffusion bridges
- Alive SMC\(^{2}\): Bayesian model selection for low-count time series models with intractable likelihoods
- Conditional Particle Filters with Bridge Backward Sampling
- \(\mathrm{SMC}^2\): an efficient algorithm for sequential analysis of state space models
- Adaptive particle allocation in iterated sequential Monte Carlo via approximating meta-models
- Without-replacement sampling for particle methods on finite state spaces
- Sequential state inference of engineering systems through the particle move-reweighting algorithm
- Automatically adapting the number of state particles in \(\text{SMC}^2\)
- Statistical inference for stochastic differential equations
- Correlated pseudo-marginal schemes for time-discretised stochastic kinetic models
- Simulation-based inference for stochastic nonlinear mixed-effects models with applications in systems biology
- Box confidence depth: simulation-based inference with hyper-rectangles
- Inference for partially observed Riemannian Ornstein-Uhlenbeck diffusions of covariance matrices
- Bayesian inference for Markov jump processes with informative observations
- Sequential sampling to myopically maximize the expected value of information
- Particle-kernel estimation of the filter density in state-space models
- Ensemble Kalman filter based sequential Monte Carlo sampler for sequential Bayesian inference
- Bayesian estimation of discretely observed diffusion processes using Wiener chaos expansion
- Improved bridge constructs for stochastic differential equations
- Inference on high-dimensional implicit dynamic models using a guided intermediate resampling filter
- Lookahead strategies for sequential Monte Carlo
- Simulating diffusion bridges with score matching
- Bagged Filters for Partially Observed Interacting Systems
- scientific article; zbMATH DE number 2044137 (Why is no real title available?)
- A coherent structure approach for parameter estimation in Lagrangian data assimilation
- Smoothing with couplings of conditional particle filters
- Some contributions to sequential Monte Carlo methods for option pricing
This page was built for publication: Sequential Monte Carlo with Highly Informative Observations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3452532)
