On unifying randomized methods for inverse problems
From MaRDI portal
Publication:6162746
Abstract: This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a sample average approximation. More importantly, we are able to prove a single theoretical result that guarantees the asymptotic convergence for a variety of randomized methods. Additionally, viewing randomized methods as a sample average approximation enables us to prove, for the first time, a single non-asymptotic error result that holds for randomized methods under consideration. Another important consequence of our unified framework is that it allows us to discover new randomization methods. We present various numerical results for linear, nonlinear, algebraic, and PDE-constrained inverse problems that verify the theoretical convergence results and provide a discussion on the apparently different convergence rates and the behavior for various randomized methods.
Recommendations
- Regularized Linear Inversion with Randomized Singular Value Decomposition
- Randomized algorithms for large-scale inverse problems with general Tikhonov regularizations
- Randomized matrix approximation to enhance regularized projection schemes in inverse problems
- On the Convergence of Stochastic Gradient Descent for Nonlinear Ill-Posed Problems
- Regularization with randomized SVD for large-scale discrete inverse problems
Cites work
- A computational framework for infinite-dimensional Bayesian inverse problems. II: stochastic Newton MCMC with application to ice sheet flow inverse problems
- A data-scalable randomized misfit approach for solving large-scale PDE-constrained inverse problems
- A generalization of the Sherman-Morrison-Woodbury formula
- A Randomized Maximum A Posteriori Method for Posterior Sampling of High Dimensional Nonlinear Bayesian Inverse Problems
- A statistical perspective on randomized sketching for ordinary least-squares
- A stochastic Newton MCMC method for large-scale statistical inverse problems with application to seismic inversion
- A stopping criterion for iterative regularization methods
- Analysis of the ensemble Kalman filter for inverse problems
- Asymptotic Statistics
- Condition numbers and perturbation analysis for the Tikhonov regularization of discrete ill-posed problems.
- Convergence rates for Tikhonov regularisation of non-linear ill-posed problems
- Covariance estimation: the GLM and regularization perspectives
- Database-friendly random projections: Johnson-Lindenstrauss with binary coins.
- Dimension-independent likelihood-informed MCMC
- Discretization-invariant Bayesian inversion and Besov space priors
- Efficient parallelisation of Metropolis-Hastings algorithms using a prefetching approach
- Ensemble Kalman methods for inverse problems
- Equation of state calculations by fast computing machines
- Fast mixing of Metropolized Hamiltonian Monte Carlo: benefits of multi-step gradients
- Feedback Particle Filter
- FEM-based discretization-invariant MCMC methods for PDE-constrained Bayesian inverse problems
- High-dimensional probability. An introduction with applications in data science
- scientific article; zbMATH DE number 1012640 (Why is no real title available?)
- scientific article; zbMATH DE number 1865939 (Why is no real title available?)
- scientific article; zbMATH DE number 3223982 (Why is no real title available?)
- Hybrid Monte Carlo on Hilbert spaces
- Inverse problems: a Bayesian perspective
- Lectures on Stochastic Programming
- Likelihood-informed dimension reduction for nonlinear inverse problems
- Linear and nonlinear inverse problems with practical applications
- Monte Carlo sampling methods using Markov chains and their applications
- On the well-posedness of Bayesian inverse problems
- Probability
- Randomize-then-optimize: a method for sampling from posterior distributions in nonlinear inverse problems
- Restoration of atmospherically blurred images by symmetric indefinite conjugate gradient techniques
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Solving large-scale PDE-constrained Bayesian inverse problems with Riemann manifold Hamiltonian Monte Carlo
- Structured condition numbers of structured Tikhonov regularization problem and their estimations
- Structured random sketching for PDE inverse problems
- The conjugate gradient regularization method in computed tomography problems
- The ensemble Kalman filter for combined state and parameter estimation
- Variational Analysis
- Γ -convergence of Onsager–Machlup functionals: I. With applications to maximum a posteriori estimation in Bayesian inverse problems
Cited in
(5)- On the randomised stability constant for inverse problems
- Randomized approach to nonlinear inversion combining random and optimized simultaneous sources and detectors
- scientific article; zbMATH DE number 1821202 (Why is no real title available?)
- A data-scalable randomized misfit approach for solving large-scale PDE-constrained inverse problems
- On the Convergence of Stochastic Gradient Descent for Nonlinear Ill-Posed Problems
This page was built for publication: On unifying randomized methods for inverse problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6162746)
