Quasi-Newton Methods, Motivation and Theory

DOI10.1137/1019005zbMath0356.65041MaRDI QIDQ4127886

Jorge J. Moré, John E. jun. Dennis

Publication date: 1977

Published in: SIAM Review (Search for Journal in Brave)

Full work available at URL: https://hdl.handle.net/1813/6056

Mathematics Subject Classification ID

65K05: Numerical mathematical programming methods

65H10: Numerical computation of solutions to systems of equations

Related Items

On the superlinear convergence of the successive approximations method, Secant relations versus positive definiteness in quasi-Newton methods, Natural finite element techniques for viscous fluid motion, A quasi-Newton method with modification of one column per iteration, On diagonally preconditioning the truncated Newton method for super-scale linearly constrained nonlinear prrogramming, Quasi-Newton methods for solving underdetermined nonlinear simultaneous equations, An algorithm to initialize the search of solutions of polynomial systems, A type of modified BFGS algorithm with any rank defects and the local \(Q\)-superlinear convergence properties, Partitioning group correction Cholesky techniques for large scale sparse unconstrained optimization, Global convergence properties of two modified BFGS-type methods, Some numerical experiments with variable-storage quasi-Newton algorithms, The global and superlinear convergence of a new nonmonotone MBFGS algorithm on convex objective functions, A modified BFGS method and its superlinear convergence in nonconvex minimization with general line search rule, Incomplete Jacobian Newton method for nonlinear equations, Operating characteristics of hyperbolically and elliptically constrained self-adaptive incremental Newton-Raphson algorithms, Some investigations in a new algorithm for nonlinear optimization based on conic models of the objective function, A class of superlinearly convergent projection algorithms with relaxed stepsizes, Convergent stepsizes for constrained optimization algorithms, On the convergence of curvilinear search algorithms in unconstrained optimization, More results on the convergence of iterative methods for the symmetric linear complementarity problem, The projection method for solving nonlinear systems of equations under the most violated constraint control, Quasi-Newton methods with factorization scaling for solving sparse nonlinear systems of equations, Finding a positive semidefinite interval for a parametric matrix, The behavior of trust-region methods in FIML-estimation, Iterative solution of integral equations by a quasi-Newton method, A finite element computation of moderate Reynolds fluid flow using a modified Marquardt method, Local convergence of the multi-secant method for the parallel solution of systems of nonlinear equations, Inertia-preserving secant updates, Recent developments in constrained optimization, Some efficient algorithms for unconstrained discrete-time optimal control problems, Preconditioned Newton methods using incremental unknowns methods for the resolution of a steady-state Navier-Stokes-like problem, Two examples on the convergence of certain rank-2 minimization methods for quadratic functionals in Hilbert space, Distance preserving linear feature selection, Über die globale Konvergenz von Variable-Metrik-Verfahren mit nicht- exakter Schrittweitenbestimmung, A switching regression method using inequality conditions, A generalized direct search acceptable-point technique for use with descent-type multivariate algorithms, On the numerical solution of non-linear equations characterizing minimal cubature formulae, Global approximate Newton methods, On the efficient computation of the nonlinear full-information maximum- likelihood estimator, A variant of the generalized reduced gradient algorithm for non-linear programming and its applications, Minimizing a differentiable function over a differential manifold, An assessment of quasi-Newton sparse update techniques for nonlinear structural analysis, A variable metric algorithm for unconstrained minimization without evaluation of derivatives, Superlinear convergence of symmetric Huang's class of methods, On making large nonlinear problems small, A generalized Newton algorithm using higher-order derivatives, Engineering applications of the Chow-Yorke algorithm, Partitioned variable metric updates for large structured optimization problems, Overhang of a heavy elastic sheet, An element-by-element solution algorithm for problems of structural and solid mechanics, Formal convergence characteristics of elliptically constrained incremental Newton-Raphson algorithms, Karmarkar's linear programming algorithm and Newton's method, Convergence of quasi-Newton matrices generated by the symmetric rank one update, On simulation and optimization of macroeconometric models, Nonlinear CG-like iterative methods, A globally and quadratically convergent affine scaling method for linear \(l_ 1\) problems, Modified proximal point algorithm for extended linear-quadratic programming, A quasi-Gauss-Newton method for solving nonlinear algebraic equations, Composite Newton-PCG and quasi-Newton iterations for nonlinear consolidation, Local convergence of quasi-Newton methods for B-differentiable equations, A stochastic quasigradient algorithm with variable metric, On the computation of a versal family of matrices, Diagonalized multiplier methods and quasi-Newton methods for constrained optimization, On the relation between quadratic termination and convergence properties of minimization algorithms. Part I. Theory, Rank-one modification of the symmetric eigenproblem, On orthogonal trajectories and optimization, Nonoptimal termination properties of quadratic interpolation univariate searches, Respecifying the weighting matrix of a quadratic objective function, A unified derivation of quasi-Newton methods for solving non-sparse and sparse nonlinear equations, On the computational competitiveness of full-information maximum- likelihood and three-stage least-squares in the estimation of nonlinear, simultaneous-equations models, ``Proper binormal ROC curves: Theory and maximum-likelihood estimation, Inexact generalized Newton methods for second order \(C\)-differentiable optimization, Convergence of partially asynchronous block quasi-Newton methods for nonlinear systems of equations, An arc length control procedure to solve parabolic problems, Local analysis of Newton-type methods for variational inequalities and nonlinear programming, New variable-metric algorithms for nondifferentiable optimization problems, Numerical simulation of tridimensional electromagnetic shaping of liquid metals, Backward perturbation analysis of certain characteristic subspaces, On Davidon's collinear scaling algorithms for optimization, Difference equations and local convergence of inexact Newton methods, Modifying the BFGS update by a new column scaling technique, The least prior deviation quasi-Newton update, Interpolation by conic model for unconstrained optimization, The linear algebra of block quasi-Newton algorithms, Hybrid algorithms with automatic switching for solving nonlinear equation systems, Variable metric bundle methods: From conceptual to implementable forms, Modifying the BFGS method, New version of the Newton method for nonsmooth equations, Performance of several nonlinear programming software packages on microcomputers., Inverse \(q\)-columns updating methods for solving nonlinear systems of equations, Global convergence of nonmonotone strategies in parallel methods for block-bordered nonlinear systems, Symbiosis between linear algebra and optimization, Practical quasi-Newton methods for solving nonlinear systems, Convergence property of a class of variable metric methods., Nonmonotone backtracking inexact quasi-Newton algorithms for solving smooth nonlinear equations, A rank-one fitting algorithm for unconstrained optimization problems., A family of variable metric proximal methods, The revised DFP algorithm without exact line search, Variable-metric technique for the solution of affinely parametrized nondifferentiable optimal design problems, Local convergence analysis for partitioned quasi-Newton updates, Some Numerical Results Using a Sparse Matrix Updating Formula in Unconstrained Optimization, Minimum Norm Symmetric Quasi-Newton Updates Restricted to Subspaces, A Collocation Solver for Mixed Order Systems of Boundary Value Problems, Convergence in Karmarkar's algorithm: a review, Local andQ-superlinear convergence of a class of collinear scaling algorithms that extends quasi-newton methods with broyden's bounded-⊘ class of updates† ‡, On The convergence of the quasi-gauss-newton methods for solving nonlinear systems, Extra updates for the bfgs method^∗, A derivative-free line search and global convergence of Broyden-like method for nonlinear equations, Iterative methods for computing generalized inverses related with optimization methods, Some theoretical properties of Feng-Schnabel algorithm for block bordered nonlinear systems, Inexact Newton methods for the nonlinear complementarity problem, Symmetric minimum-norm updates for use in gibbs free energy calculations, Unnamed Item, The inexact, inexact perturbed, and quasi-Newton methods are equivalent models, A numerical evaluation of some collinear scaling algorithms for unconstrained, On the convergence of quasi-newton methods for nonsmooth problems, Cost approximation algorithms with nonmonotone line searches for a general class of nonlinear programs, Efficiency and implementation of simplicial zero point algorithms, Convergence analysis of the Levenberg–Marquardt method, Unnamed Item, Globally convergent inexact generalized Newton method for first-order differentiable optimization problems, Arbitrary Lagrangian-Eulerian formulation for fluid-rigid body interaction, A modified BFGS method and its global convergence in nonconvex minimization, Inexact perturbed Newton methods and applications to a class of Krylov solvers, Maintaining factorized KKT systems subject to rank-one updates of Hessians and Jacobians, Free rotation of a circular ring about a diameter, Global convergence enhancement of classical linesearch interior point methods for MCPs, Convergence theorems for parallel multisplitting two-stage iterative methods for mildly nonlinear systems, Global convergence of the Broyden's class of quasi-Newton methods with nonmonotone linesearch, Hartley-type algebras in displacement and optimization strategies., Global convergence properties of the modified BFGS method associating with general line search model, A two-piece update of projected Hessian algorithm with nonmonotonic trust region method for constrained optimization, The convergence of quasi-Gauss-Newton methods for nonlinear problems, A quasi-second-order proximal bundle algorithm, A new family of preconditioned iterative solvers for nonsymmetric linear systems, Least-squares solution of \(F=PG\) over positive semidefinite symmetric \(P\), Common periodic behavior in larger and larger truncations of the Navier-Stokes equations., Cam-Clay plasticity. III: Extension of the infinitesimal model to include finite strains, Deriving collinear scaling algorithms as extensions of quasi-Newton methods and the local convergence of DFP- and BFGS-related collinear scaling algorithms, Exact penalty function algorithm with simple updating of the penalty parameter, Parameter estimation in flow through partially saturated porous materials, An autoadaptative limited memory Broyden's method to solve systems of nonlinear equations, Truncated partitioning group correction algorithms for large-scale sparse unconstrained optimi\-zation, Lower-dimensional linear complementarity problem approaches to the solution of a bi-obstacle problem, An unconditionally stable, energy-momentum consistent implementation of the material-point method, Global convergence of a modified BFGS-type method for unconstrained non-convex minimization, Efficient solution of nonlinear elliptic problems using hierarchical matrices with Broyden updates, Divide and conquer algorithms for computing the eigendecomposition of symmetric diagonal-plus-semiseparable matrices, Spectral gradient projection method for solving nonlinear monotone equations, The substitution secant/finite difference method for large scale sparse unconstrained optimization, Micromechanics of granular media. I: Generation of overall constitutive equation for assemblies of circular disks, An affine scaling trust-region algorithm with interior backtracking technique for solving bound-constrained nonlinear systems, Affine scaling inexact generalized Newton algorithm with interior backtracking technique for solving bound-constrained semismooth equations, Newton methods for nonsmooth convex minimization: connections among \(\mathcal U\)-Lagrangian, Riemannian Newton and SQP methods, On the convergence of Broyden-like methods for nonlinear equations with nondifferentiable terms, An analysis of reduced Hessian methods for constrained optimization, Maintaining the positive definiteness of the matrices in reduced secant methods for equality constrained optimization, A nonmonotone Broyden method for unconstrained optimization, Algorithms for solving non-linear inequalities in a finite number of iterations using approximate derivatives, Truncated-Newton algorithms for large-scale unconstrained optimization, An aggregate subgradient method for nonsmooth convex minimization, A CLASS OF DFP ALGORITHMS WITH REVISED SEARCH DIRECTION, A hybrid algorithm for finding a global minimum, The convergence of variable metric matrices in unconstrained optimization, Local and superlinear convergence for truncated iterated projections methods, Methods of the secant type for systems of equations with symmetric jacobian matrix, A Sparse Quasi-Newton Update Derived Variationally with a Nondiagonally Weighted Frobenius Norm, A new class of quasi-Newton updating formulas, Unnamed Item, ADAPTIVE ALGORITHMS FOR NEURAL NETWORK SUPERVISED LEARNING: A DETERMINISTIC OPTIMIZATION APPROACH, Optimization of unconstrained functions with sparse Hessian matrices—Quasi-Newton methods, An alternative variational principle for variable metric updating, Computing nonlinear network equilibria, Newton's method for constrained optimization, Paralleling computations when solving systems of nonlinear algebraic equations, The method of successive affine reduction for nonlinear minimization, Thermocapillary free boundaries in crystal growth, Comparison of direct optimization algorithms for dynamic network flow control, Mise à jour de la métrique dans les méthodes de quasi-Newton réduites en optimisation avec contraintes d'égalité, Efficient computation of lod scores: genotype elimination, genotype redefinition, and hybrid maximum likelihood algorithms, On the local and global convergence of a reduced Quasi-Newton method¹, Variable metric methods for minimizing a class of nondifferentiable functions, Combined lp and quasi-Newton methods for minimax optimization, Superlinear convergence of Broyden's boundedθ-class of methods, A note about sparsity exploiting quasi-Newton updates, A Hybrid Algorithm for Solving Sparse Nonlinear Systems of Equations, On Secant Updates for Use in General Constrained Optimization, Conjugate direction methods with variable storage, Nonlinear programming via an exact penalty function: Asymptotic analysis, Majorizing Sequences and Error Bounds for Iterative Methods, Initial Value Methods for Parabolic Control Problems, Stable symmetric secant methods with restart, Updating Quasi-Newton Matrices with Limited Storage, Direct Secant Updates of Matrix Factorizations, Unnamed Item, Algorithms for nonlinear constraints that use lagrangian functions, A new arc algorithm for unconstrained optimization, Nonlinear hybrid procedures and fixed point iterations, On broyden's method for the regularization of nonlinear ill-posed problems, A derivative-free line search and dfp method for symmetric equations with global and superlinear convergence, Consistent tangent matrices for substepping schemes, Properties and numerical performance of quasi-Newton methods with modified quasi-Newton equations, Convergence of the DFP algorithm without exact line search