A generalization of variable elimination for separable inverse problems beyond least squares
From MaRDI portal
Abstract: In linear inverse problems, we have data derived from a noisy linear transformation of some unknown parameters, and we wish to estimate these unknowns from the data. Separable inverse problems are a powerful generalization in which the transformation itself depends on additional unknown parameters and we wish to determine both sets of parameters simultaneously. When separable problems are solved by optimization, convergence can often be accelerated by elimination of the linear variables, a strategy which appears most prominently in the variable projection methods due to Golub, Pereyra, and Kaufman. Existing variable elimination methods require an explicit formula for the optimal value of the linear variables, so they cannot be used in problems with Poisson likelihoods, bound constraints, or other important departures from least squares. To address this limitation, we propose a generalization of variable elimination in which standard optimization methods are modified to behave as though a variable has been eliminated. We verify that this approach is a proper generalization by using it to re-derive several existing variable elimination techniques. We then extend the approach to bound-constrained and Poissonian problems, showing in the process that many of the best features of variable elimination methods can be duplicated in our framework. Tests on difficult exponential sum fitting and blind deconvolution problems indicate that the proposed approach can have significant speed and robustness advantages over standard methods.
Recommendations
- Separable nonlinear least squares: the variable projection method and its applications
- Estimating nuisance parameters in inverse problems
- On the separable nonlinear least squares problems
- Secant variable projection method for solving nonnegative separable least squares problems
- An efficient iterative approach for large-scale separable nonlinear inverse problems
Cited in
(10)- Numerical reduced variable optimization methods via implicit functional dependence with applications
- Variable Projection for NonSmooth Problems
- Variable projection algorithms: theoretical insights and a novel approach for problems with large residual
- Variable projection methods for an optimized dynamic mode decomposition
- Variable projection methods for separable nonlinear inverse problems with general-form Tikhonov regularization
- LAP: A linearize and project method for solving inverse problems with coupled variables
- Numerical approximation of partial differential equations by a variable projection method with artificial neural networks
- Estimating nuisance parameters in inverse problems
- Variable projection for nonsmooth problems
- Shortcut derivatives for mixed linear-nonlinear least squares regression
This page was built for publication: A generalization of variable elimination for separable inverse problems beyond least squares
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2852305)
