Nested particle filters for online parameter estimation in discrete-time state-space Markov models

DOI10.3150/17-BEJ954zbMATH Open1414.62346arXiv1308.1883OpenAlexW2963672032MaRDI QIDQ1708992FDOQ1708992

Authors: Dan Crisan, Joaquín Míguez 

Publication date: 27 March 2018

Published in: Bernoulli (Search for Journal in Brave)

Abstract: We address the problem of approximating the posterior probability distribution of the fixed parameters of a state-space dynamical system using a sequential Monte Carlo method. The proposed approach relies on a nested structure that employs two layers of particle filters to approximate the posterior probability measure of the static parameters and the dynamic state variables of the system of interest, in a vein similar to the recent "sequential Monte Carlo square" (SMC${}^2$) algorithm. However, unlike the SMC${}^2$ scheme, the proposed technique operates in a purely recursive manner. In particular, the computational complexity of the recursive steps of the method introduced herein is constant over time. We analyse the approximation of integrals of real bounded functions with respect to the posterior distribution of the system parameters computed via the proposed scheme. As a result, we prove, under regularity assumptions, that the approximation errors vanish asymptotically in $L_p$ ($pge1$) with convergence rate proportional to $frac1sqrtN+frac1sqrtM$, where $N$ is the number of Monte Carlo samples in the parameter space and $NimesM$ is the number of samples in the state space. This result also holds for the approximation of the joint posterior distribution of the parameters and the state variables. We discuss the relationship between the SMC${}^2$ algorithm and the new recursive method and present a simple example in order to illustrate some of the theoretical findings with computer simulations.

Full work available at URL: https://arxiv.org/abs/1308.1883

Recommendations

• Uniform convergence over time of a nested particle filtering scheme for recursive parameter estimation in state-space Markov models
• A Kalman particle filter for online parameter estimation with applications to affine models
• Particle-based online estimation of tangent filters with application to parameter estimation in nonlinear state-space models
• Parameter estimation in general state-space models using particle methods
• \(\mathrm{SMC}^2\): an efficient algorithm for sequential analysis of state space models

zbMATH Keywords

parameter estimationMonte Carloerror boundsstate space modelsparticle filteringrecursive algorithmsmodel inference

Mathematics Subject Classification ID

Bayesian inference (62F15) Markov processes: estimation; hidden Markov models (62M05) Inference from stochastic processes and prediction (62M20) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Cites Work

• On the stability of sequential Monte Carlo methods in high dimensions
• Adaptive joint detection and decoding in flat-fading channels via mixture Kalman filtering
• Sequential Imputations and Bayesian Missing Data Problems
• Title not available (Why is that?)
• SMC2: An Efficient Algorithm for Sequential Analysis of State Space Models
• Title not available (Why is that?)
• A sequential particle filter method for static models
• Sequential Monte Carlo Methods for Dynamic Systems
• Particle approximations of the score and observed information matrix in state space models with application to parameter estimation
• Deterministic Nonperiodic Flow
• Sequential Monte Carlo smoothing with application to parameter estimation in nonlinear state space models
• On particle methods for parameter estimation in state-space models
• Following a moving target -- Monte Carlo inference for dynamic Bayesian models
• Particle Markov chain Monte Carlo for efficient numerical simulation
• Uniform Stability of a Particle Approximation of the Optimal Filter Derivative
• A survey of convergence results on particle filtering methods for practitioners
• Particle learning and smoothing
• Title not available (Why is that?)
• Title not available (Why is that?)
• Dimensional reduction for a Bayesian filter
• Title not available (Why is that?)
• Title not available (Why is that?)
• Parameter estimation and asymptotic stability in stochastic filtering
• On the convergence of two sequential Monte Carlo methods for maximum a posteriori sequence estimation and stochastic global optimization
• Sequential Monte Carlo methods for nonlinear discrete-time filtering
• A Particle Filtering Scheme for Processing Time Series Corrupted by Outliers
• A population Monte Carlo scheme with transformed weights and its application to stochastic kinetic models

Cited In (19)

• Parallel sequential Monte Carlo for stochastic gradient-free nonconvex optimization
• Nudging the particle filter
• Sequential estimation of temporally evolving latent space network models
• A sequential importance sampling filter with a new proposal distribution for state and parameter estimation of nonlinear dynamical systems
• On the performance of particle filters with adaptive number of particles
• Title not available (Why is that?)
• Boolean Kalman filter and smoother under model uncertainty
• A rare event approach to high-dimensional approximate Bayesian computation
• Automatically adapting the number of state particles in \(\text{SMC}^2\)
• Convergence of Regularized Particle Filters for Stochastic Reaction Networks
• Optimal estimation of amplitude and phase modulated signals
• A Kalman particle filter for online parameter estimation with applications to affine models
• Parallelizing particle filters with butterfly interactions
• Stochastic Filtering Methods in Electronic Trading
• On classical and Bayesian asymptotics in state space stochastic differential equations
• Particle approximations of the score and observed information matrix in state space models with application to parameter estimation
• On-Line Inference for Hidden Markov Models via Particle Filters
• Biased online parameter inference for state-space models
• A Particle Filter for Stochastic Advection by Lie Transport: A Case Study for the Damped and Forced Incompressible Two-Dimensional Euler Equation

This page was built for publication: Nested particle filters for online parameter estimation in discrete-time state-space Markov models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1708992)