Data-free likelihood-informed dimension reduction of Bayesian inverse problems
From MaRDI portal
Abstract: Identifying a low-dimensional informed parameter subspace offers a viable path to alleviating the dimensionality challenge in the sampled-based solution to large-scale Bayesian inverse problems. This paper introduces a novel gradient-based dimension reduction method in which the informed subspace does not depend on the data. This permits an online-offline computational strategy where the expensive low-dimensional structure of the problem is detected in an offline phase, meaning before observing the data. This strategy is particularly relevant for multiple inversion problems as the same informed subspace can be reused. The proposed approach allows controlling the approximation error (in expectation over the data) of the posterior distribution. We also present sampling strategies that exploit the informed subspace to draw efficiently samples from the exact posterior distribution. The method is successfully illustrated on two numerical examples: a PDE-based inverse problem with a Gaussian process prior and a tomography problem with Poisson data and a Besov- prior.
Recommendations
- Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
- Likelihood-informed dimension reduction for nonlinear inverse problems
- Data-driven model reduction for the Bayesian solution of inverse problems
- Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method
- Accelerating the Bayesian inference of inverse problems by using data-driven compressive sensing method based on proper orthogonal decomposition
Cites work
- A computational framework for infinite-dimensional Bayesian inverse problems. II: stochastic Newton MCMC with application to ice sheet flow inverse problems
- A note on the Poincaré inequality for convex domains
- A tensor approximation method based on ideal minimal residual formulations for the solution of high-dimensional problems
- Accelerating Markov chain Monte Carlo with active subspaces
- Active subspace methods in theory and practice: applications to kriging surfaces
- Adaptive dimension reduction to accelerate infinite-dimensional geometric Markov chain Monte Carlo
- An explicit link between Gaussian fields and Gaussian Markov random fields: the stochastic partial differential equation approach
- Besov priors for Bayesian inverse problems
- Convergence properties of pseudo-marginal Markov chain Monte Carlo algorithms
- Dimension-independent likelihood-informed MCMC
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Discretization-invariant Bayesian inversion and Besov space priors
- Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator
- Equation of state calculations by fast computing machines
- Establishing some order amongst exact approximations of MCMCs
- Forward and backward uncertainty quantification with active subspaces: application to hypersonic flows around a cylinder
- Generalized bounds for active subspaces
- Geometric MCMC for infinite-dimensional inverse problems
- Gradient-based dimension reduction of multivariate vector-valued functions
- Handbook of Markov Chain Monte Carlo
- High-dimensional Bayesian inference via the unadjusted Langevin algorithm
- scientific article; zbMATH DE number 1619459 (Why is no real title available?)
- Inverse Problem Theory and Methods for Model Parameter Estimation
- Inverse problems: a Bayesian perspective
- Likelihood-informed dimension reduction for nonlinear inverse problems
- Log-concave sampling: Metropolis-Hastings algorithms are fast
- MCMC METHODS FOR DIFFUSION BRIDGES
- MCMC methods for functions: modifying old algorithms to make them faster
- Monte Carlo sampling methods using Markov chains and their applications
- Monte Carlo strategies in scientific computing
- Multilevel sequential Monte Carlo with dimension-independent likelihood-informed proposals
- Optimal low-rank approximations of Bayesian linear inverse problems
- Optimal scaling for various Metropolis-Hastings algorithms.
- Poincaré inequalities on intervals -- application to sensitivity analysis
- Quasi-Monte Carlo finite element methods for elliptic PDEs with lognormal random coefficients
- Quasi-Monte Carlo methods for elliptic PDEs with random coefficients and applications
- Reduced basis approximation and a posteriori error estimation for affinely parametrized elliptic coercive partial differential equations. Application to transport and continuum mechanics.
- Ridge functions
- Sequential Monte Carlo Methods for Dynamic Systems
- Sequential Monte Carlo Samplers
- Sparsity-promoting Bayesian inversion
- Spectral Methods for Uncertainty Quantification
- Séminaire de Probabilités XXXVI
- The pseudo-marginal approach for efficient Monte Carlo computations
- Theoretical Guarantees for Approximate Sampling from Smooth and Log-Concave Densities
- Weak convergence and optimal scaling of random walk Metropolis algorithms
Cited in
(28)- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Multimodal, high-dimensional, model-based, Bayesian inverse problems with applications in biomechanics
- Objective-sensitive principal component analysis for high-dimensional inverse problems
- Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion
- An adaptive reduced basis ANOVA method for high-dimensional Bayesian inverse problems
- Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
- A unified performance analysis of likelihood-informed subspace methods
- On dimension reduction in Gaussian filters
- Likelihood-informed dimension reduction for nonlinear inverse problems
- Data-driven model reduction for the Bayesian solution of inverse problems
- Optimal low-rank approximations of Bayesian linear inverse problems
- Sampling-free Bayesian inversion with adaptive hierarchical tensor representations
- Prior normalization for certified likelihood-informed subspace detection of Bayesian inverse problems
- Certified dimension reduction in nonlinear Bayesian inverse problems
- Goal-oriented optimal approximations of Bayesian linear inverse problems
- Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method
- Scalable conditional deep inverse Rosenblatt transports using tensor trains and gradient-based dimension reduction
- A data-driven and model-based accelerated Hamiltonian Monte Carlo method for Bayesian elliptic inverse problems
- Bayesian inference of vorticity in unbounded flow from limited pressure measurements
- A new bi-fidelity model reduction method for Bayesian inverse problems
- Certified coordinate selection for high-dimensional Bayesian inversion with Laplace prior
- Principal feature detection via -Sobolev inequalities
- hIPPYlib-MUQ: a Bayesian inference software framework for integration of data with complex predictive models under uncertainty
- Sharp detection of low-dimensional structure in probability measures via dimensional logarithmic Sobolev inequalities
- Coupled input-output dimension reduction: application to goal-oriented Bayesian experimental design and global sensitivity analysis
- Derivative-informed neural operator acceleration of geometric MCMC for infinite-dimensional Bayesian inverse problems
- Uncertainty quantification for linear inverse problems with Besov prior: a randomize-then-optimize method
- Expected information gain estimation via density approximations: sample allocation and dimension reduction
This page was built for publication: Data-free likelihood-informed dimension reduction of Bayesian inverse problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5859742)