Quasi-Newton Methods, Motivation and Theory

DOI10.1137/1019005zbMath0356.65041MaRDI QIDQ4127886

Jorge J. Moré, John E. jun. Dennis

Publication date: 1977

Published in: SIAM Review (Search for Journal in Brave)

Full work available at URL: https://hdl.handle.net/1813/6056

Mathematics Subject Classification ID

65K05: Numerical mathematical programming methods

65H10: Numerical computation of solutions to systems of equations

Related Items

Some Numerical Results Using a Sparse Matrix Updating Formula in Unconstrained Optimization, Minimum Norm Symmetric Quasi-Newton Updates Restricted to Subspaces, A Collocation Solver for Mixed Order Systems of Boundary Value Problems, Convergence in Karmarkar's algorithm: a review, Local andQ-superlinear convergence of a class of collinear scaling algorithms that extends quasi-newton methods with broyden's bounded-⊘ class of updates† ‡, On The convergence of the quasi-gauss-newton methods for solving nonlinear systems, On the superlinear convergence of the successive approximations method, Some efficient algorithms for unconstrained discrete-time optimal control problems, Preconditioned Newton methods using incremental unknowns methods for the resolution of a steady-state Navier-Stokes-like problem, Two examples on the convergence of certain rank-2 minimization methods for quadratic functionals in Hilbert space, Distance preserving linear feature selection, Über die globale Konvergenz von Variable-Metrik-Verfahren mit nicht- exakter Schrittweitenbestimmung, A switching regression method using inequality conditions, A generalized direct search acceptable-point technique for use with descent-type multivariate algorithms, On the numerical solution of non-linear equations characterizing minimal cubature formulae, Global approximate Newton methods, On the efficient computation of the nonlinear full-information maximum- likelihood estimator, A variant of the generalized reduced gradient algorithm for non-linear programming and its applications, Minimizing a differentiable function over a differential manifold, An assessment of quasi-Newton sparse update techniques for nonlinear structural analysis, A variable metric algorithm for unconstrained minimization without evaluation of derivatives, Karmarkar's linear programming algorithm and Newton's method, Convergence of quasi-Newton matrices generated by the symmetric rank one update, On simulation and optimization of macroeconometric models, Nonlinear CG-like iterative methods, A globally and quadratically convergent affine scaling method for linear \(l_ 1\) problems, Modified proximal point algorithm for extended linear-quadratic programming, A quasi-Gauss-Newton method for solving nonlinear algebraic equations, Composite Newton-PCG and quasi-Newton iterations for nonlinear consolidation, Local convergence of quasi-Newton methods for B-differentiable equations, A stochastic quasigradient algorithm with variable metric, On the computation of a versal family of matrices, Diagonalized multiplier methods and quasi-Newton methods for constrained optimization, On the relation between quadratic termination and convergence properties of minimization algorithms. Part I. Theory, Rank-one modification of the symmetric eigenproblem, On orthogonal trajectories and optimization, Nonoptimal termination properties of quadratic interpolation univariate searches, Respecifying the weighting matrix of a quadratic objective function, A unified derivation of quasi-Newton methods for solving non-sparse and sparse nonlinear equations, On the computational competitiveness of full-information maximum- likelihood and three-stage least-squares in the estimation of nonlinear, simultaneous-equations models, ``Proper binormal ROC curves: Theory and maximum-likelihood estimation, Inexact generalized Newton methods for second order \(C\)-differentiable optimization, Convergence of partially asynchronous block quasi-Newton methods for nonlinear systems of equations, An arc length control procedure to solve parabolic problems, Local analysis of Newton-type methods for variational inequalities and nonlinear programming, New variable-metric algorithms for nondifferentiable optimization problems, Numerical simulation of tridimensional electromagnetic shaping of liquid metals, Backward perturbation analysis of certain characteristic subspaces, On Davidon's collinear scaling algorithms for optimization, Difference equations and local convergence of inexact Newton methods, Modifying the BFGS update by a new column scaling technique, The least prior deviation quasi-Newton update, Interpolation by conic model for unconstrained optimization, The linear algebra of block quasi-Newton algorithms, Hybrid algorithms with automatic switching for solving nonlinear equation systems, Variable metric bundle methods: From conceptual to implementable forms, Modifying the BFGS method, New version of the Newton method for nonsmooth equations, Performance of several nonlinear programming software packages on microcomputers., Inverse \(q\)-columns updating methods for solving nonlinear systems of equations, Global convergence of nonmonotone strategies in parallel methods for block-bordered nonlinear systems, Symbiosis between linear algebra and optimization, Practical quasi-Newton methods for solving nonlinear systems, Convergence property of a class of variable metric methods., Nonmonotone backtracking inexact quasi-Newton algorithms for solving smooth nonlinear equations, A rank-one fitting algorithm for unconstrained optimization problems., A family of variable metric proximal methods, The revised DFP algorithm without exact line search, Global convergence enhancement of classical linesearch interior point methods for MCPs, Convergence theorems for parallel multisplitting two-stage iterative methods for mildly nonlinear systems, Global convergence of the Broyden's class of quasi-Newton methods with nonmonotone linesearch, Hartley-type algebras in displacement and optimization strategies., Global convergence properties of the modified BFGS method associating with general line search model, A two-piece update of projected Hessian algorithm with nonmonotonic trust region method for constrained optimization, The convergence of quasi-Gauss-Newton methods for nonlinear problems, A quasi-second-order proximal bundle algorithm, A new family of preconditioned iterative solvers for nonsymmetric linear systems, Least-squares solution of \(F=PG\) over positive semidefinite symmetric \(P\), Common periodic behavior in larger and larger truncations of the Navier-Stokes equations., Cam-Clay plasticity. III: Extension of the infinitesimal model to include finite strains, Micromechanics of granular media. I: Generation of overall constitutive equation for assemblies of circular disks, An affine scaling trust-region algorithm with interior backtracking technique for solving bound-constrained nonlinear systems, Affine scaling inexact generalized Newton algorithm with interior backtracking technique for solving bound-constrained semismooth equations, Newton methods for nonsmooth convex minimization: connections among \(\mathcal U\)-Lagrangian, Riemannian Newton and SQP methods, A nonmonotone Broyden method for unconstrained optimization, A CLASS OF DFP ALGORITHMS WITH REVISED SEARCH DIRECTION, Variable metric methods for minimizing a class of nondifferentiable functions, Combined lp and quasi-Newton methods for minimax optimization, Superlinear convergence of Broyden's boundedθ-class of methods, A note about sparsity exploiting quasi-Newton updates, Majorizing Sequences and Error Bounds for Iterative Methods, Initial Value Methods for Parabolic Control Problems, Stable symmetric secant methods with restart, Updating Quasi-Newton Matrices with Limited Storage, Unnamed Item, Algorithms for nonlinear constraints that use lagrangian functions, A new arc algorithm for unconstrained optimization, Nonlinear hybrid procedures and fixed point iterations, On broyden's method for the regularization of nonlinear ill-posed problems, A derivative-free line search and dfp method for symmetric equations with global and superlinear convergence, Extra updates for the bfgs method^∗, A derivative-free line search and global convergence of Broyden-like method for nonlinear equations, Iterative methods for computing generalized inverses related with optimization methods, Some theoretical properties of Feng-Schnabel algorithm for block bordered nonlinear systems, Unnamed Item, The inexact, inexact perturbed, and quasi-Newton methods are equivalent models, A numerical evaluation of some collinear scaling algorithms for unconstrained, On the convergence of quasi-newton methods for nonsmooth problems, Cost approximation algorithms with nonmonotone line searches for a general class of nonlinear programs, Unnamed Item, Globally convergent inexact generalized Newton method for first-order differentiable optimization problems, Arbitrary Lagrangian-Eulerian formulation for fluid-rigid body interaction, A modified BFGS method and its global convergence in nonconvex minimization, Inexact perturbed Newton methods and applications to a class of Krylov solvers, Consistent tangent matrices for substepping schemes, Properties and numerical performance of quasi-Newton methods with modified quasi-Newton equations, Convergence of the DFP algorithm without exact line search