Complexity analysis of accelerated MCMC methods for Bayesian inversion
From MaRDI portal
Abstract: We study Bayesian inversion for a model elliptic PDE with unknown diffusion coefficient. We provide complexity analyses of several Markov Chain-Monte Carlo (MCMC) methods for the efficient numerical evaluation of expectations under the Bayesian posterior distribution, given data . Particular attention is given to bounds on the overall work required to achieve a prescribed error level . Specifically, we first bound the computational complexity of "plain" MCMC, based on combining MCMC sampling with linear complexity multilevel solvers for elliptic PDE. Our (new) work versus accuracy bounds show that the complexity of this approach can be quite prohibitive. Two strategies for reducing the computational complexity are then proposed and analyzed: first, a sparse, parametric and deterministic generalized polynomial chaos (gpc) "surrogate" representation of the forward response map of the PDE over the entire parameter space, and, second, a novel Multi-Level Markov Chain Monte Carlo (MLMCMC) strategy which utilizes sampling from a multilevel discretization of the posterior and of the forward PDE. For both of these strategies we derive asymptotic bounds on work versus accuracy, and hence asymptotic bounds on the computational complexity of the algorithms. In particular we provide sufficient conditions on the regularity of the unknown coefficients of the PDE, and on the approximation methods used, in order for the accelerations of MCMC resulting from these strategies to lead to complexity reductions over "plain" MCMC algorithms for Bayesian inversion of PDEs.}
Recommendations
- Analysis of a multilevel Markov chain Monte Carlo finite element method for Bayesian inversion of log-normal diffusions
- Dimension-Independent MCMC Sampling for Inverse Problems with Non-Gaussian Priors
- Stochastic spectral methods for efficient Bayesian solution of inverse problems
- Quasi-Monte Carlo and multilevel Monte Carlo methods for computing posterior expectations in elliptic inverse problems
- Stochastic collocation algorithms using \(l_1\)-minimization for Bayesian solution of inverse problems
Cited in
(62)- Quasi-Monte Carlo and multilevel Monte Carlo methods for computing posterior expectations in elliptic inverse problems
- (Non)-penalized multilevel methods for non-uniformly log-concave distributions
- Approximation and sampling of multivariate probability distributions in the tensor train decomposition
- Randomized approaches to accelerate MCMC algorithms for Bayesian inverse problems
- Accuracy of some approximate Gaussian filters for the Navier-Stokes equation in the presence of model error
- Sparse variational Bayesian approximations for nonlinear inverse problems: applications in nonlinear elastography
- scientific article; zbMATH DE number 7709350 (Why is no real title available?)
- Sparse-grid, reduced-basis Bayesian inversion
- Higher-order quasi-Monte Carlo for Bayesian shape inversion
- Analysis of nested multilevel Monte Carlo using approximate normal random variables
- Bayesian inversion for electromyography using low-rank tensor formats
- Markov chain simulation for multilevel Monte Carlo
- Stein variational reduced basis Bayesian inversion
- A dynamic bi-orthogonal field equation approach to efficient Bayesian inversion
- Multi-index sequential Monte Carlo ratio estimators for Bayesian inverse problems
- Analysis of a multilevel Markov chain Monte Carlo finite element method for Bayesian inversion of log-normal diffusions
- Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems
- Deep neural network expression of posterior expectations in Bayesian PDE inversion
- Hessian-based adaptive sparse quadrature for infinite-dimensional Bayesian inverse problems
- Multilevel ensemble Kalman filtering for spatio-temporal processes
- Dimension-independent likelihood-informed MCMC
- A randomized multi-index sequential Monte Carlo method
- Stochastic Galerkin Finite Element Method with Local Conductivity Basis for Electrical Impedance Tomography
- Multilevel sequential Monte Carlo: Mean square error bounds under verifiable conditions
- FEM-based discretization-invariant MCMC methods for PDE-constrained Bayesian inverse problems
- Multilevel ensemble Kalman filtering
- A Bayesian level set method for the shape reconstruction of inverse scattering problems in elasticity
- Bayesian inverse problems for recovering coefficients of two scale elliptic equations
- Multilevel dimension-independent likelihood-informed MCMC for large-scale inverse problems
- A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
- Multilevel sequential Monte Carlo with dimension-independent likelihood-informed proposals
- A low-rank solver for parameter estimation and uncertainty quantification in time-dependent systems of partial differential equations
- A Bayesian scheme for reconstructing obstacles in acoustic waveguides
- Multilevel higher-order quasi-Monte Carlo Bayesian estimation
- Application of quasi-Monte Carlo methods to elliptic PDEs with random diffusion coefficients: a survey of analysis and implementation
- Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings
- Multilevel Markov Chain Monte Carlo
- Sequential Monte Carlo methods for Bayesian elliptic inverse problems
- A Benchmark for the Bayesian Inversion of Coefficients in Partial Differential Equations
- On the convergence of the Laplace approximation and noise-level-robustness of Laplace-based Monte Carlo methods for Bayesian inverse problems
- Sparse-grid, reduced-basis Bayesian inversion: nonaffine-parametric nonlinear equations
- Itô-SDE MCMC method for Bayesian characterization of errors associated with data limitations in stochastic expansion methods for uncertainty quantification
- Identifying a fractional order and a time-dependent coefficient in a time-fractional diffusion wave equation
- Bayesian inversion of log-normal eikonal equations
- Numerical realization of the Bayesian inversion accelerated using surrogate models.
- Bayesian inverse problems with Monte Carlo forward models
- Statistical guarantees for Bayesian uncertainty quantification in nonlinear inverse problems with Gaussian process priors
- Bayesian static parameter estimation for partially observed diffusions via multilevel Monte Carlo
- Stochastic spectral methods for efficient Bayesian solution of inverse problems
- Multilevel Particle Filters
- Advanced Multilevel Monte Carlo Methods
- Accelerating Metropolis-within-Gibbs sampler with localized computations of differential equations
- Scalable Optimization-Based Sampling on Function Space
- Dimension-Independent MCMC Sampling for Inverse Problems with Non-Gaussian Priors
- Multilevel Markov chain Monte Carlo for Bayesian inverse problem for Navier-Stokes equation
- Acoustic full waveform inversion with Hamiltonian Monte Carlo method
- Multilevel Markov chain Monte Carlo for Bayesian inversion of parabolic partial differential equations under Gaussian prior
- Optimal Bayesian experimental design for electrical impedance tomography in medical imaging
- A Bayesian estimation method for variational phase-field fracture problems
- Central limit theorems for multilevel Monte Carlo methods
- Multilevel Quasi-Monte Carlo Uncertainty Quantification for Advection-Diffusion-Reaction
- Multilevel sequential Monte Carlo samplers
This page was built for publication: Complexity analysis of accelerated MCMC methods for Bayesian inversion
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2866183)
