Optimal Low-rank Approximations of Bayesian Linear Inverse Problems

DOI10.1137/140977308zbMath1325.62060arXiv1407.3463OpenAlexW2963964397MaRDI QIDQ3452481

No author found.

Publication date: 12 November 2015

Published in: SIAM Journal on Scientific Computing (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1407.3463

zbMATH Keywords

inverse problemsoptimalityBayesian inferenceBayes risklow-rank approximationcovariance approximationFörstner-Moonen metricposterior mean approximation

Mathematics Subject Classification ID

Bayesian inference (62F15) Biomedical imaging and signal processing (92C55) Inverse problems in linear algebra (15A29) Approximation algorithms (68W25)

Related Items

Coupling Techniques for Nonlinear Ensemble Filtering ⋮ Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction ⋮ Multilevel Sequential Monte Carlo with Dimension-Independent Likelihood-Informed Proposals ⋮ Low-Rank Eigenvector Compression of Posterior Covariance Matrices for Linear Gaussian Inverse Problems ⋮ Algorithms for Kullback--Leibler Approximation of Probability Measures in Infinite Dimensions ⋮ Reduced modeling of unknown trajectories ⋮ A Multiscale Strategy for Bayesian Inference Using Transport Maps ⋮ Model reduction of linear dynamical systems via balancing for Bayesian inference ⋮ Stochastic Learning Approach for Binary Optimization: Application to Bayesian Optimal Design of Experiments ⋮ Optimal projection of observations in a Bayesian setting ⋮ Certified dimension reduction in nonlinear Bayesian inverse problems ⋮ An approximate empirical Bayesian method for large-scale linear-Gaussian inverse problems ⋮ On convergence rates of adaptive ensemble Kalman inversion for linear ill-posed problems ⋮ A unified performance analysis of likelihood-informed subspace methods ⋮ Stein Variational Gradient Descent on Infinite-Dimensional Space and Applications to Statistical Inverse Problems ⋮ Time-limited balanced truncation for data assimilation problems ⋮ Numerical linear algebra in data assimilation ⋮ Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method ⋮ Thermal uncertainty analysis of a single particle model for a lithium-ion cell ⋮ Hierarchical off-diagonal low-rank approximation of Hessians in inverse problems, with application to ice sheet model initialization ⋮ Scalable Optimization-Based Sampling on Function Space ⋮ Multilevel dimension-independent likelihood-informed MCMC for large-scale inverse problems ⋮ Iterative Importance Sampling Algorithms for Parameter Estimation ⋮ Efficient generalized Golub–Kahan based methods for dynamic inverse problems ⋮ Goal-Oriented Optimal Approximations of Bayesian Linear Inverse Problems ⋮ A multiscale method for model order reduction in PDE parameter estimation ⋮ Multimodal, high-dimensional, model-based, Bayesian inverse problems with applications in biomechanics ⋮ Localization for MCMC: sampling high-dimensional posterior distributions with local structure ⋮ Adaptive dimension reduction to accelerate infinite-dimensional geometric Markov chain Monte Carlo ⋮ MALA-within-Gibbs Samplers for High-Dimensional Distributions with Sparse Conditional Structure ⋮ Tensor Train Construction From Tensor Actions, With Application to Compression of Large High Order Derivative Tensors ⋮ Unnamed Item ⋮ Bayesian inference of random fields represented with the Karhunen-Loève expansion ⋮ Importance sampling: intrinsic dimension and computational cost ⋮ Linearized Bayesian inference for Young’s modulus parameter field in an elastic model of slender structures ⋮ Low-Rank Independence Samplers in Hierarchical Bayesian Inverse Problems ⋮ Scalable and efficient algorithms for the propagation of uncertainty from data through inference to prediction for large-scale problems, with application to flow of the antarctic ice sheet ⋮ Spatial localization for nonlinear dynamical stochastic models for excitable media ⋮ Accelerating Markov Chain Monte Carlo with Active Subspaces ⋮ Hessian-based adaptive sparse quadrature for infinite-dimensional Bayesian inverse problems ⋮ Simultaneous Sensing Error Recovery and Tomographic Inversion Using an Optimization-Based Approach ⋮ Scalable Matrix-Free Adaptive Product-Convolution Approximation for Locally Translation-Invariant Operators ⋮ Efficient Marginalization-Based MCMC Methods for Hierarchical Bayesian Inverse Problems ⋮ Unnamed Item ⋮ Stein Variational Reduced Basis Bayesian Inversion ⋮ Cross-Entropy-Based Importance Sampling with Failure-Informed Dimension Reduction for Rare Event Simulation ⋮ Deep composition of tensor-trains using squared inverse Rosenblatt transports ⋮ Data-free likelihood-informed dimension reduction of Bayesian inverse problems ⋮ Optimal Regularized Inverse Matrices for Inverse Problems

Uses Software

• EIGIFP
• LSQR
• Regularization tools
• L-BFGS
• JDQR
• ARPACK
• UTV
• JDQZ
• LSRN
• CRAIG

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• An Explicit Link between Gaussian Fields and Gaussian Markov Random Fields: The Stochastic Partial Differential Equation Approach
• Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions
• On the limited memory BFGS method for large scale optimization
• Large-scale Kalman filtering using the limited memory BFGS method
• Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
• Regularization methods for large-scale problems
• On the regularizing properties of the GMRES method
• Statistical and computational inverse problems.
• Regularization, GSVD and truncated GSVD
• Optimal filters from calibration data for image deconvolution with data acquisition error
• Simplified GSVD computations for the solution of linear discrete ill-posed problems
• Dimension-independent likelihood-informed MCMC
• Variational ensemble Kalman filtering using limited memory BFGS
• Preconditioned iterative methods for linear discrete ill-posed problems from a Bayesian inversion perspective
• Optimal regularized low rank inverse approximation
• The variational Kalman filter and an efficient implementation using limited memory BFGS
• Bayesian Preconditioned CGLS for Source Separation in MEG Time Series
• LSRN: A Parallel Iterative Solver for Strongly Over- or Underdetermined Systems
• Analysis of the Hessian for inverse scattering problems: I. Inverse shape scattering of acoustic waves
• Left and right preconditioning for electrical impedance tomography with structural information
• Inverse problems: A Bayesian perspective
• A Stochastic Newton MCMC Method for Large-Scale Statistical Inverse Problems with Application to Seismic Inversion
• Sampling Gaussian Distributions in Krylov Spaces with Conjugate Gradients
• An efficient approach for computing optimal low-rank regularized inverse matrices
• Likelihood-informed dimension reduction for nonlinear inverse problems
• Scaling limits in computational Bayesian inversion
• Parameter and State Model Reduction for Large-Scale Statistical Inverse Problems
• Fast Algorithms for Bayesian Uncertainty Quantification in Large-Scale Linear Inverse Problems Based on Low-Rank Partial Hessian Approximations
• Designing Optimal Spectral Filters for Inverse Problems
• The Efficient Generation of Random Orthogonal Matrices with an Application to Condition Estimators
• On the Rates of Convergence of the Lanczos and the Block-Lanczos Methods
• Updating Quasi-Newton Matrices with Limited Storage
• Towards a Generalized Singular Value Decomposition
• A Trace Minimization Algorithm for the Generalized Eigenvalue Problem
• Pseudoinversus and conjugate gradients
• Generalizing the Singular Value Decomposition
• Error Analysis of the Lanczos Algorithm for Tridiagonalizing a Symmetric Matrix
• Numerical Optimization
• Fast and Exact Simulation of Stationary Gaussian Processes through Circulant Embedding of the Covariance Matrix
• ARPACK Users' Guide
• Templates for the Solution of Algebraic Eigenvalue Problems
• Derivatives of Spectral Functions
• An Inverse Free Preconditioned Krylov Subspace Method for Symmetric Generalized Eigenvalue Problems
• Adaptive Hessian-Based Nonstationary Gaussian Process Response Surface Method for Probability Density Approximation with Application to Bayesian Solution of Large-Scale Inverse Problems
• Hessian‐based model reduction: large‐scale inversion and prediction
• Generalized Rank-Constrained Matrix Approximations
• A Computational Framework for Infinite-Dimensional Bayesian Inverse Problems Part I: The Linearized Case, with Application to Global Seismic Inversion
• Convergence in Variance of Chebyshev Accelerated Gibbs Samplers
• Estimates for Some Computational Techniques in Linear Algebra
• Computational Variants of the Lanczos Method for the Eigenproblem
• Priorconditioners for linear systems
• Methods of conjugate gradients for solving linear systems
• Data Assimilation