Likelihood-informed dimension reduction for nonlinear inverse problems
From MaRDI portal
Abstract: The intrinsic dimensionality of an inverse problem is affected by prior information, the accuracy and number of observations, and the smoothing properties of the forward operator. From a Bayesian perspective, changes from the prior to the posterior may, in many problems, be confined to a relatively low-dimensional subspace of the parameter space. We present a dimension reduction approach that defines and identifies such a subspace, called the "likelihood-informed subspace" (LIS), by characterizing the relative influences of the prior and the likelihood over the support of the posterior distribution. This identification enables new and more efficient computational methods for Bayesian inference with nonlinear forward models and Gaussian priors. In particular, we approximate the posterior distribution as the product of a lower-dimensional posterior defined on the LIS and the prior distribution marginalized onto the complementary subspace. Markov chain Monte Carlo sampling can then proceed in lower dimensions, with significant gains in computational efficiency. We also introduce a Rao-Blackwellization strategy that de-randomizes Monte Carlo estimates of posterior expectations for additional variance reduction. We demonstrate the efficiency of our methods using two numerical examples: inference of permeability in a groundwater system governed by an elliptic PDE, and an atmospheric remote sensing problem based on Global Ozone Monitoring System (GOMOS) observations.
Recommendations
- Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
- Data-free likelihood-informed dimension reduction of Bayesian inverse problems
- A unified performance analysis of likelihood-informed subspace methods
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method
Cited in
(86)- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Reduced modeling of unknown trajectories
- Optimal projection of observations in a Bayesian setting
- Geometric MCMC for infinite-dimensional inverse problems
- Multimodal, high-dimensional, model-based, Bayesian inverse problems with applications in biomechanics
- Importance sampling: intrinsic dimension and computational cost
- Bayesian inference of random fields represented with the Karhunen-Loève expansion
- A stochastic subspace approach to gradient-free optimization in high dimensions
- Ensemble sampler for infinite-dimensional inverse problems
- Deep composition of tensor-trains using squared inverse Rosenblatt transports
- Forward and backward uncertainty quantification with active subspaces: application to hypersonic flows around a cylinder
- Model reduction of linear dynamical systems via balancing for Bayesian inference
- Spectral gap of replica exchange Langevin diffusion on mixture distributions
- Rate-optimal refinement strategies for local approximation MCMC
- Generalized bounds for active subspaces
- Localization for MCMC: sampling high-dimensional posterior distributions with local structure
- Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion
- Adaptive dimension reduction to accelerate infinite-dimensional geometric Markov chain Monte Carlo
- Bayesian inference of heterogeneous epidemic models: application to COVID-19 spread accounting for long-term care facilities
- Spatial localization for nonlinear dynamical stochastic models for excitable media
- The curse of dimensionality in inverse problems
- Dimension-independent likelihood-informed MCMC
- Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
- Sparse variational Bayesian approximations for nonlinear inverse problems: applications in nonlinear elastography
- Coordinate transformation and polynomial chaos for the Bayesian inference of a Gaussian process with parametrized prior covariance function
- A unified performance analysis of likelihood-informed subspace methods
- Thermal uncertainty analysis of a single particle model for a lithium-ion cell
- On dimension reduction in Gaussian filters
- Accelerating Markov chain Monte Carlo with active subspaces
- Accelerated dimension-independent adaptive metropolis
- Scaling limits in computational Bayesian inversion
- A Randomized Maximum A Posteriori Method for Posterior Sampling of High Dimensional Nonlinear Bayesian Inverse Problems
- Multilevel sequential Monte Carlo with dimension-independent likelihood-informed proposals
- A multiscale strategy for Bayesian inference using transport maps
- Bayesian inverse regression for supervised dimension reduction with small datasets
- Optimal low-rank approximations of Bayesian linear inverse problems
- Coordinate Based Empirical Likelihood-Like Estimation in Ill-Conditioned Inverse Problems
- An approximate empirical Bayesian method for large-scale linear-Gaussian inverse problems
- Survey of multifidelity methods in uncertainty propagation, inference, and optimization
- Iterative importance sampling algorithms for parameter estimation
- Inference via low-dimensional couplings
- Langevin diffusion for population based sampling with an application in Bayesian inference for pharmacodynamics
- Multilevel hierarchical decomposition of finite element white noise with application to multilevel Markov chain Monte Carlo
- Cross-Entropy-Based Importance Sampling with Failure-Informed Dimension Reduction for Rare Event Simulation
- Prior normalization for certified likelihood-informed subspace detection of Bayesian inverse problems
- Efficient derivative-free Bayesian inference for large-scale inverse problems
- Coupling techniques for nonlinear ensemble filtering
- Certified dimension reduction in nonlinear Bayesian inverse problems
- Multifidelity Dimension Reduction via Active Subspaces
- Scalable Optimization-Based Sampling on Function Space
- Multiscale model reduction method for Bayesian inverse problems of subsurface flow
- Replica exchange for non-convex optimization
- Multilevel Hierarchical Decomposition of Finite Element White Noise with Application to Multilevel Markov Chain Monte Carlo
- Pass-efficient randomized algorithms for low-rank matrix approximation using any number of views
- Scalable Matrix-Free Adaptive Product-Convolution Approximation for Locally Translation-Invariant Operators
- Quantifying and reducing model-form uncertainties in Reynolds-averaged Navier-Stokes simulations: a data-driven, physics-informed Bayesian approach
- Nonlinear model reduction for uncertainty quantification in large-scale inverse problems
- Goal-oriented optimal approximations of Bayesian linear inverse problems
- Data-free likelihood-informed dimension reduction of Bayesian inverse problems
- Learning physics-based models from data: perspectives from inverse problems and model reduction
- Numerical linear algebra in data assimilation
- Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method
- On unifying randomized methods for inverse problems
- Inverse modeling of nonisothermal multiphase poromechanics using physics-informed neural networks
- Enabling Hyper-Differential Sensitivity Analysis for Ill-Posed Inverse Problems
- Large Deviation Theory-based Adaptive Importance Sampling for Rare Events in High Dimensions
- Deep Importance Sampling Using Tensor Trains with Application to a Priori and a Posteriori Rare Events
- A dimension-reduced variational approach for solving physics-based inverse problems using generative adversarial network priors and normalizing flows
- Multilevel dimension-independent likelihood-informed MCMC for large-scale inverse problems
- Point spread function approximation of high-rank Hessians with locally supported nonnegative integral kernels
- Model reduction from partial observations
- Conditional sampling with monotone GANs: from generative models to likelihood-free inference
- Principal feature detection via -Sobolev inequalities
- Optimal experimental design: formulations and computations
- Bayesian inversion with Student's t priors based on Gaussian scale mixtures
- Diffeomorphism-based feature learning using Poincaré inequalities on augmented input space
- Sharp detection of low-dimensional structure in probability measures via dimensional logarithmic Sobolev inequalities
- Coupled input-output dimension reduction: application to goal-oriented Bayesian experimental design and global sensitivity analysis
- Data-informed model reduction for inference and prediction from non-identifiable models
- Change of measure for Bayesian field inversion with hierarchical hyperparameters sampling
- High-dimensional nonlinear Bayesian inference of poroelastic fields from pressure data
- Optimal low-rank posterior mean and distribution approximation in linear Gaussian inverse problems on Hilbert spaces
- Independent approximation in separable Hilbert spaces via spectral truncation
- Preconditioned pseudo-time continuation for parameterized inverse problems
- Scalability of the second-order reliability method for stochastic differential equations with multiplicative noise
- Expected information gain estimation via density approximations: sample allocation and dimension reduction
This page was built for publication: Likelihood-informed dimension reduction for nonlinear inverse problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2936510)
