A stable particle filter for a class of high-dimensional state-space models

DOI10.1017/APR.2016.77MaRDI QIDQ5233157zbMATH OpenOpenAlexFDO

Authors Alexandros Beskos, Ajay Jasra, Kengo Kamatani, Yan Zhou, Dan Crisan

Publication date 16 September 2019

Published in Advances in Applied Probability (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1412.3501, http://discovery.ucl.ac.uk/1556083/

zbMATH Keywords

high dimensionsparticle filterstate-space model

Mathematics Subject Classification ID

Signal detection and filtering (aspects of stochastic processes) (60G35) Inference from stochastic processes and prediction (62M20)

Abstract: We consider the numerical approximation of the filtering problem in high dimensions, that is, when the hidden state lies in $mathbb{R}^d$ with $d$ large. For low dimensional problems, one of the most popular numerical procedures for consistent inference is the class of approximations termed particle filters or sequential Monte Carlo methods. However, in high dimensions, standard particle filters (e.g. the bootstrap particle filter) can have a cost that is exponential in $d$ for the algorithm to be stable in an appropriate sense. We develop a new particle filter, called the emph{space-time particle filter}, for a specific family of state-space models in discrete time. This new class of particle filters provide consistent Monte Carlo estimates for any fixed $d$, as do standard particle filters. Moreover, we expect that the state-space particle filter will scale much better with $d$ than the standard filter. We illustrate this analytically for a model of a simple i.i.d. structure and one of a Markovian structure in the $d$-dimensional space-direction, when we show that the algorithm exhibits certain stability properties as $d$ increases at a cost $mathcalO(nN{d}^2)$, where $n$ is the time parameter and $N$ is the number of Monte Carlo samples, that are fixed and independent of $d$. Similar results are expected to hold, under a more general structure than the i.i.d.~one. independently of the dimension. Our theoretical results are also supported by numerical simulations on practical models of complex structures. The results suggest that it is indeed possible to tackle some high dimensional filtering problems using the space-time particle filter that standard particle filters cannot handle.

Recommendations

• A lagged particle filter for stable filtering of certain high-dimensional state-space models
• Can local particle filters beat the curse of dimensionality?
• scientific article; zbMATH DE number 6469926
• Stability properties of some particle filters
• How to avoid the curse of dimensionality: scalability of particle filters with and without importance weights

Cites work

• A lognormal central limit theorem for particle approximations of normalizing constants
• A nonasymptotic theorem for unnormalized Feynman-Kac particle models
• Can local particle filters beat the curse of dimensionality?
• Error bounds and normalising constants for sequential Monte Carlo samplers in high dimensions
• scientific article; zbMATH DE number 5919872 (Why is no real title available?)
• scientific article; zbMATH DE number 4174133 (Why is no real title available?)
• scientific article; zbMATH DE number 2106098 (Why is no real title available?)
• Mean field simulation for Monte Carlo integration
• On adaptive resampling strategies for sequential Monte Carlo methods
• On parallel implementation of sequential Monte Carlo methods: the island particle model
• On the stability of sequential Monte Carlo methods in high dimensions
• Particle approximations of the score and observed information matrix in state space models with application to parameter estimation
• Sequential Monte Carlo methods for high-dimensional inverse problems: a case study for the Navier-Stokes equations
• Sequential Monte Carlo Samplers

Cited in

(46)

• A method for high-dimensional smoothing
• Importance sampling: intrinsic dimension and computational cost
• Multilevel ensemble Kalman filtering for spatio-temporal processes
• Spatiotemporal blocking of the bouncy particle sampler for efficient inference in state-space models
• Real-time estimation and prediction of unsteady flows using reduced-order models coupled with few measurements
• Clustered exact Daum-Huang particle flow filter
• Asymptotic properties of particle filter-based maximum likelihood estimators for state space models
• Data assimilation -- mathematical foundation and applications. Abstracts from the workshop held February 20--26, 2022
• Efficient estimation and particle filter for max-stable processes
• Stability properties of some particle filters
• How to avoid the curse of dimensionality: scalability of particle filters with and without importance weights
• Accuracy of some approximate Gaussian filters for the Navier-Stokes equation in the presence of model error
• Numerically modeling stochastic Lie transport in fluid dynamics
• Unbiased multi-index Monte Carlo
• A lagged particle filter for stable filtering of certain high-dimensional state-space models
• Some contributions to sequential Monte Carlo methods for option pricing
• Ensemble Kalman methods for high-dimensional hierarchical dynamic space-time models
• A particle filter for stochastic advection by Lie transport: a case study for the damped and forced incompressible two-dimensional Euler equation
• Particle Filtering for Stochastic Navier--Stokes Signal Observed with Linear Additive Noise
• Sequential Monte Carlo methods for Bayesian elliptic inverse problems
• Sequential estimation of temporally evolving latent space network models
• On spatially correlated observations in importance sampling methods for subsidence estimation
• Bagged Filters for Partially Observed Interacting Systems
• Sequential discretization schemes for a class of stochastic differential equations and their application to Bayesian filtering
• A divide and conquer sequential Monte Carlo approach to high dimensional filtering
• An iterated block particle filter for inference on coupled dynamic systems with shared and unit-specific parameters
• Stratified epidemic model using a latent marked Hawkes process
• Nested smoothing algorithms for inference and tracking of heterogeneous multi-scale state-space systems
• Storvik, Palomares, Engebretsen, Rø, Engø-Monsen, Kristoffersen, De Blasio and Frigessi's reply to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Bhatt, Ferguson, Flaxman, Gandy, Mishra, and Scott's reply to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Jorge Mateu and Álvaro Briz-Redón's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Andrew B. Lawson's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Hans R. Künsch and Fabio Sigrist's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Sawitree Boonpatcharanon, Jane Heffernan and Hanna Jankowski's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Heejong Bong, Valerie Ventura and Larry Wasserman's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Alice Corbella, Anne M. Presanis, Paul J. Birrell and Daniela de Angelis's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Sanmitra Ghosh's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Paul J. Birrell, Angelos Alexopoulos and Daniela de Angelis's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Arun Chind's contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Seconder of the vote of thanks and contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Proposer of the vote of thanks and contribution to the discussion of `The second discussion meeting on statistical aspects of the COVID-19 pandemic'
• Semi-mechanistic Bayesian modelling of COVID-19 with renewal processes
• Stochastic geometric models with non-stationary spatial correlations in Lagrangian fluid flows
• Inference on high-dimensional implicit dynamic models using a guided intermediate resampling filter
• Can local particle filters beat the curse of dimensionality?
• An algorithm for non-parametric estimation in state-space models

This page was built for publication: A stable particle filter for a class of high-dimensional state-space models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5233157)