Variational Methods for Non-Linear Least-Squares
The authors consider numerical methods for solving the unconstrained nonlinear least squares problem, and try to find a compromise between the Gauss-Newton-method and an appropriate quasi-Newton-method with the aim to get an algorithm suitable for small and large residual problems. Various alternatives are discussed to find an updating formula for least squares problems proceeding either from the BFGS- or the DFP-formula. Based on numerical experience,the final proposal of the authors is to use a simple hybrid method without optimal scaling combining the Gauss-Newton and the BFGS-method, where the difference vector of successive gradients is modified to take advantage of the special problem structure. The usage of a line search is recommended and details of the numerical implementation are presented. The new code is compared experimentally with a pure Gauss-Newton, a pure BFGS- and a standard method of the IMSL library (NL2S1, Dennis et al.). The numerical tests are based on classical test problems and some new large residual test problems. They indicate that the proposed method is more robust and slightly more efficient with respect to residual evaluations.
- Variational methods in nonlinear problems
- scientific article; zbMATH DE number 4113592
- Variational-iterative method for nonlinear equations
- Variable projection for nonlinear least squares problems
- scientific article; zbMATH DE number 811900
- Variational methods for non-variational problems
- A Variational Approach to Nonlinear Estimation
- Nonlinear least squares and Sobolev gradients
- Variable metric methods for unconstrained optimization and nonlinear least squares
- Variational quasi-Newton methods for unconstrained optimization
- An efficient line search for nonlinear least squares
- Numerical experiments with variations of the Gauss-Newton algorithm for nonlinear least squares
- Convergence theory for the structured BFGS secant method with an application to nonlinear least squares
- Hybrid method for nonlinear least-square problems without calculating derivatives
- On simulation and optimization of macroeconometric models
- Hierarchical gradient methods for nonlinear LSQ problems
- Variationally derived scaling and variable metric updates from the preconvex part of the Broyden family
- Variational quasi-Newton methods for unconstrained optimization
- Computational experience with known variable metric updates
- Variable metric methods for unconstrained optimization and nonlinear least squares
- A structured diagonal Hessian approximation method with evaluation complexity analysis for nonlinear least squares
- An adaptive trust region algorithm for large-residual nonsmooth least squares problems
- Stability analysis of the method of seminormal equations for linear least squares problems
- A review of the parameter estimation problem of fitting positive exponential sums to empirical data
- Hybrid methods for large sparse nonlinear least squares
- Nonlinear least squares and Sobolev gradients
- A flow perspective on nonlinear least-squares problems
- A brief survey of methods for solving nonlinear least-squares problems
- Scaled nonlinear conjugate gradient methods for nonlinear least squares problems
- Structured two-point stepsize gradient methods for nonlinear least squares
- Global convergence of Gauss-Newton-MBFGS method for solving the nonlinear least squares problem
- scientific article; zbMATH DE number 3843082 (Why is no real title available?)
- Least squares methods in maximum likelihood problems
- scientific article; zbMATH DE number 3921800 (Why is no real title available?)
- Robust nonlinear least squares estimation using the Chow-Yorke homotopy method
- scientific article; zbMATH DE number 3982410 (Why is no real title available?)
- Hybrid Methods for Nonlinear Least Squares
- scientific article; zbMATH DE number 4108053 (Why is no real title available?)
- scientific article; zbMATH DE number 1014733 (Why is no real title available?)
- scientific article; zbMATH DE number 1014734 (Why is no real title available?)
- A new extended matrix logarithm formulation for the simulation of viscoelastic fluids by spectral elements
- scientific article; zbMATH DE number 1524377 (Why is no real title available?)
- Variants of Non-Negative Least-Mean-Square Algorithm and Convergence Analysis
- Newton-type methods for nonlinear least squares using restricted second order information
- Superlinearly convergent exact penalty methods with projected structured secant updates for constrained nonlinear least squares
- scientific article; zbMATH DE number 1839618 (Why is no real title available?)
- scientific article; zbMATH DE number 869697 (Why is no real title available?)
- A hybrid method for nonlinear least squares that uses quasi-Newton updates applied to an approximation of the Jacobian matrix.
- New basic Hessian approximations for large-scale nonlinear least-squares optimization
- A hybrid method for nonlinear least squares problems
- Stable factorized quasi-Newton methods for nonlinear least-squares problems
- A new structured spectral conjugate gradient method for nonlinear least squares problems
- On the local convergence of a smoothing structured secant method for nonlinear complementarity
- An augmented Lagrangian algorithm for constrained nonlinear least-squares
- Variational approximation for heteroscedastic linear models and matching pursuit algorithms
- A modified quasi-Newton method for structured optimization with partial information on the Hessian
- Augmented penalty algorithms based on BFGS secant approximations and trust regions
- Nonlinear conjugate gradient methods with structured secant condition for nonlinear least squares problems
- A new structured quasi-Newton algorithm using partial information on Hessian
This page was built for publication: Variational Methods for Non-Linear Least-Squares
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3700720)