Multilevel sequential Monte Carlo for Bayesian inverse problems
From MaRDI portal
Publication:725440
Abstract: The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior information to estimate the posterior distribution of a parameter. Specifically, we are interested in the distribution of a diffusion coefficient of an elliptic PDE. In this setting, the sample space is high-dimensional, and each sample of the PDE solution is expensive. To address these issues we propose and analyse a novel Sequential Monte Carlo (SMC) sampler for the approximation of the posterior distribution. Classical, single-level SMC constructs a sequence of measures, starting with the prior distribution, and finishing with the posterior distribution. The intermediate measures arise from a tempering of the likelihood, or, equivalently, a rescaling of the noise. The resolution of the PDE discretisation is fixed. In contrast, our estimator employs a hierarchy of PDE discretisations to decrease the computational cost. We construct a sequence of intermediate measures by decreasing the temperature or by increasing the discretisation level at the same time. This idea builds on and generalises the multi-resolution sampler proposed in [P.S. Koutsourelakis, J. Comput. Phys., 228 (2009), pp. 6184-6211] where a bridging scheme is used to transfer samples from coarse to fine discretisation levels. Importantly, our choice between tempering and bridging is fully adaptive. We present numerical experiments in 2D space, comparing our estimator to single-level SMC and the multi-resolution sampler.
Recommendations
- Multilevel sequential Monte Carlo samplers
- Multilevel sequential Monte Carlo with dimension-independent likelihood-informed proposals
- Sequential Monte Carlo methods for Bayesian elliptic inverse problems
- A Bayesian approach to multiscale inverse problems using the sequential Monte Carlo method
- Multilevel Sequential Monte Carlo Samplers for Normalizing Constants
Cites work
- A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
- A multi-resolution, non-parametric, Bayesian framework for identification of spatially-varying model parameters
- A sequential particle filter method for static models
- An Inverse Problem for the Steady State Diffusion Equation
- Analysis of the ensemble Kalman filter for inverse problems
- Can local particle filters beat the curse of dimensionality?
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Ensemble Kalman methods for inverse problems
- Equation of state calculations by fast computing machines
- Fundamentals of nonparametric Bayesian inference
- scientific article; zbMATH DE number 5919872 (Why is no real title available?)
- scientific article; zbMATH DE number 3680932 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- Importance sampling: intrinsic dimension and computational cost
- Inference for Lévy-driven stochastic volatility models via adaptive sequential Monte Carlo
- Inverse problems: a Bayesian perspective
- Iterative updating of model error for Bayesian inversion
- MCMC METHODS FOR DIFFUSION BRIDGES
- MCMC methods for functions: modifying old algorithms to make them faster
- Monte Carlo sampling methods using Markov chains and their applications
- Multilevel ensemble Kalman filtering
- Multilevel estimation of rare events
- Multilevel Monte Carlo Path Simulation
- Multilevel sequential Monte Carlo samplers
- Multilevel Sequential Monte Carlo Samplers for Normalizing Constants
- Multilevel sequential Monte Carlo: Mean square error bounds under verifiable conditions
- On the convergence of adaptive sequential Monte Carlo methods
- Probability theory. A comprehensive course
- Sequential Monte Carlo methods for Bayesian elliptic inverse problems
- Sequential Monte Carlo methods for high-dimensional inverse problems: a case study for the Navier-Stokes equations
- Sequential Monte Carlo Samplers
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
- Solving large-scale PDE-constrained Bayesian inverse problems with Riemann manifold Hamiltonian Monte Carlo
- Spatial variation. 2nd ed
- Statistical and computational inverse problems.
- Uncertainty Quantification and Weak Approximation of an Elliptic Inverse Problem
Cited in
(33)- Bayesian inference of random fields represented with the Karhunen-Loève expansion
- Generalized parallel tempering on Bayesian inverse problems
- Multi-index ensemble Kalman filtering
- Bayesian updating and marginal likelihood estimation by cross entropy based importance sampling
- Sequential ensemble transform for Bayesian inverse problems
- Central limit theorems for multilevel Monte Carlo methods
- A transport-based multifidelity preconditioner for Markov chain Monte Carlo
- Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
- Binned Multilevel Monte Carlo for Bayesian Inverse Problems with Large Data
- Multilevel higher-order quasi-Monte Carlo Bayesian estimation
- Multilevel sequential importance sampling for rare event estimation
- Multilevel Monte Carlo Covariance Estimation for the Computation of Sobol' Indices
- Multilevel Markov chain Monte Carlo for Bayesian inversion of parabolic partial differential equations under Gaussian prior
- A practical example for the non-linear Bayesian filtering of model parameters
- Adaptive regularisation for ensemble Kalman inversion
- Multilevel adaptive sparse Leja approximations for Bayesian inverse problems
- Bayesian Parameter Identification in Cahn--Hilliard Models for Biological Growth
- Multilevel Markov Chain Monte Carlo
- Transform-based particle filtering for elliptic Bayesian inverse problems
- Bayesian inversion by parallel interacting Markov chains
- The ensemble Kalman filter for rare event estimation
- Advanced Multilevel Monte Carlo Methods
- Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings
- Context-Aware Surrogate Modeling for Balancing Approximation and Sampling Costs in Multifidelity Importance Sampling and Bayesian Inverse Problems
- Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method
- Bayesian Inverse Problems Are Usually Well-Posed
- Multi-agent reinforcement learning aided sampling algorithms for a class of multiscale inverse problems
- Adaptive reduced tempering for Bayesian inverse problems and rare event simulation
- Derivative-informed neural operator acceleration of geometric MCMC for infinite-dimensional Bayesian inverse problems
- Multilevel Markov chain Monte Carlo with likelihood scaling for Bayesian inversion with high-resolution observations
- Multilevel MCMC with level-dependent data in a model case of structural damage assessment
- Multi-level data assimilation for ocean forecasting using the shallow-water equations
- A multi-resolution, non-parametric, Bayesian framework for identification of spatially-varying model parameters
This page was built for publication: Multilevel sequential Monte Carlo for Bayesian inverse problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q725440)
