Likelihood-informed dimension reduction for nonlinear inverse problems
From MaRDI portal
Abstract: The intrinsic dimensionality of an inverse problem is affected by prior information, the accuracy and number of observations, and the smoothing properties of the forward operator. From a Bayesian perspective, changes from the prior to the posterior may, in many problems, be confined to a relatively low-dimensional subspace of the parameter space. We present a dimension reduction approach that defines and identifies such a subspace, called the "likelihood-informed subspace" (LIS), by characterizing the relative influences of the prior and the likelihood over the support of the posterior distribution. This identification enables new and more efficient computational methods for Bayesian inference with nonlinear forward models and Gaussian priors. In particular, we approximate the posterior distribution as the product of a lower-dimensional posterior defined on the LIS and the prior distribution marginalized onto the complementary subspace. Markov chain Monte Carlo sampling can then proceed in lower dimensions, with significant gains in computational efficiency. We also introduce a Rao-Blackwellization strategy that de-randomizes Monte Carlo estimates of posterior expectations for additional variance reduction. We demonstrate the efficiency of our methods using two numerical examples: inference of permeability in a groundwater system governed by an elliptic PDE, and an atmospheric remote sensing problem based on Global Ozone Monitoring System (GOMOS) observations.
Recommendations
- Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
- Data-free likelihood-informed dimension reduction of Bayesian inverse problems
- A unified performance analysis of likelihood-informed subspace methods
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method
Cited in
(80)- Nonlinear model reduction for uncertainty quantification in large-scale inverse problems
- Pass-efficient randomized algorithms for low-rank matrix approximation using any number of views
- Deep composition of tensor-trains using squared inverse Rosenblatt transports
- Model reduction from partial observations
- Coupling techniques for nonlinear ensemble filtering
- Efficient derivative-free Bayesian inference for large-scale inverse problems
- Data-informed model reduction for inference and prediction from non-identifiable models
- A Randomized Maximum A Posteriori Method for Posterior Sampling of High Dimensional Nonlinear Bayesian Inverse Problems
- An approximate empirical Bayesian method for large-scale linear-Gaussian inverse problems
- Sparse variational Bayesian approximations for nonlinear inverse problems: applications in nonlinear elastography
- Multilevel Hierarchical Decomposition of Finite Element White Noise with Application to Multilevel Markov Chain Monte Carlo
- Coordinate transformation and polynomial chaos for the Bayesian inference of a Gaussian process with parametrized prior covariance function
- Change of measure for Bayesian field inversion with hierarchical hyperparameters sampling
- A multiscale strategy for Bayesian inference using transport maps
- Forward and backward uncertainty quantification with active subspaces: application to hypersonic flows around a cylinder
- Importance sampling: intrinsic dimension and computational cost
- Certified dimension reduction in nonlinear Bayesian inverse problems
- Iterative importance sampling algorithms for parameter estimation
- Inverse modeling of nonisothermal multiphase poromechanics using physics-informed neural networks
- High-dimensional nonlinear Bayesian inference of poroelastic fields from pressure data
- Coordinate Based Empirical Likelihood-Like Estimation in Ill-Conditioned Inverse Problems
- Conditional sampling with monotone GANs: from generative models to likelihood-free inference
- Principal feature detection via -Sobolev inequalities
- On unifying randomized methods for inverse problems
- Bayesian inference of heterogeneous epidemic models: application to COVID-19 spread accounting for long-term care facilities
- Optimal experimental design: formulations and computations
- Dimension-independent likelihood-informed MCMC
- Reduced modeling of unknown trajectories
- Model reduction of linear dynamical systems via balancing for Bayesian inference
- Data-free likelihood-informed dimension reduction of Bayesian inverse problems
- Learning physics-based models from data: perspectives from inverse problems and model reduction
- On dimension reduction in Gaussian filters
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Accelerated dimension-independent adaptive metropolis
- Inference via low-dimensional couplings
- Numerical linear algebra in data assimilation
- scientific article; zbMATH DE number 7415116 (Why is no real title available?)
- Optimal projection of observations in a Bayesian setting
- A stochastic subspace approach to gradient-free optimization in high dimensions
- Deep Importance Sampling Using Tensor Trains with Application to a Priori and a Posteriori Rare Events
- Spectral gap of replica exchange Langevin diffusion on mixture distributions
- Spatial localization for nonlinear dynamical stochastic models for excitable media
- Scaling limits in computational Bayesian inversion
- Localization for MCMC: sampling high-dimensional posterior distributions with local structure
- Multilevel hierarchical decomposition of finite element white noise with application to multilevel Markov chain Monte Carlo
- A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flows
- Multilevel dimension-independent likelihood-informed MCMC for large-scale inverse problems
- Goal-oriented optimal approximations of Bayesian linear inverse problems
- Enabling Hyper-Differential Sensitivity Analysis for Ill-Posed Inverse Problems
- Cross-Entropy-Based Importance Sampling with Failure-Informed Dimension Reduction for Rare Event Simulation
- Optimal low-rank approximations of Bayesian linear inverse problems
- Multilevel sequential Monte Carlo with dimension-independent likelihood-informed proposals
- Bayesian inversion with Student's t priors based on Gaussian scale mixtures
- Rate-optimal refinement strategies for local approximation MCMC
- Prior normalization for certified likelihood-informed subspace detection of Bayesian inverse problems
- A unified performance analysis of likelihood-informed subspace methods
- Ensemble sampler for infinite-dimensional inverse problems
- Sharp detection of low-dimensional structure in probability measures via dimensional logarithmic Sobolev inequalities
- Geometric MCMC for infinite-dimensional inverse problems
- Large Deviation Theory-based Adaptive Importance Sampling for Rare Events in High Dimensions
- Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion
- Generalized bounds for active subspaces
- Diffeomorphism-based feature learning using Poincaré inequalities on augmented input space
- Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
- Bayesian inverse regression for supervised dimension reduction with small datasets
- Langevin diffusion for population based sampling with an application in Bayesian inference for pharmacodynamics
- Thermal uncertainty analysis of a single particle model for a lithium-ion cell
- Adaptive dimension reduction to accelerate infinite-dimensional geometric Markov chain Monte Carlo
- Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method
- Bayesian inference of random fields represented with the Karhunen-Loève expansion
- Scalable Optimization-Based Sampling on Function Space
- Coupled input-output dimension reduction: application to goal-oriented Bayesian experimental design and global sensitivity analysis
- Multiscale model reduction method for Bayesian inverse problems of subsurface flow
- Survey of multifidelity methods in uncertainty propagation, inference, and optimization
- Multimodal, high-dimensional, model-based, Bayesian inverse problems with applications in biomechanics
- Multifidelity Dimension Reduction via Active Subspaces
- Point spread function approximation of high-rank Hessians with locally supported nonnegative integral kernels
- Scalable Matrix-Free Adaptive Product-Convolution Approximation for Locally Translation-Invariant Operators
- Accelerating Markov chain Monte Carlo with active subspaces
- Quantifying and reducing model-form uncertainties in Reynolds-averaged Navier-Stokes simulations: a data-driven, physics-informed Bayesian approach
This page was built for publication: Likelihood-informed dimension reduction for nonlinear inverse problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2936510)
