Quasi-Newton Methods, Motivation and Theory

DOI10.1137/1019005zbMath0356.65041OpenAlexW2062294426MaRDI QIDQ4127886

Jorge J. Moré, John E. jun. Dennis

Publication date: 1977

Published in: SIAM Review (Search for Journal in Brave)

Full work available at URL: https://hdl.handle.net/1813/6056

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Numerical computation of solutions to systems of equations (65H10)

Related Items (only showing first 100 items - show all)

On the implementation of a quasi-Newton interior-point method for PDE-constrained optimization using finite element discretizations ⋮ Finding zeros of Hölder metrically subregular mappings via globally convergent Levenberg–Marquardt methods ⋮ A symmetric grouped and ordered multi-secant Quasi-Newton update formula ⋮ The inexact, inexact perturbed, and quasi-Newton methods are equivalent models ⋮ Full-Span Log-Linear Model and Fast Learning Algorithm ⋮ A numerical evaluation of some collinear scaling algorithms for unconstrained ⋮ Adapting Broyden method to handle linear constraints imposed via Lagrange multipliers ⋮ Variable metric method for unconstrained multiobjective optimization problems ⋮ Partial Newton-correction method for multiple fixed points of semi-linear differential operators by Legendre-Gauss-Lobatto pseudospectral method ⋮ Eigenvalue-Corrected Natural Gradient Based on a New Approximation ⋮ Regularization of limited memory quasi-Newton methods for large-scale nonconvex minimization ⋮ A derivative-free line search technique for Broyden-like method with applications to NCP, wLCP and SI ⋮ A new multipoint symmetric secant method with a dense initial matrix ⋮ A \(J\)-symmetric quasi-Newton method for minimax problems ⋮ Globally convergent coderivative-based generalized Newton methods in nonsmooth optimization ⋮ How accurate does Newton have to be? ⋮ The Integrated Nested Laplace Approximation for Fitting Dirichlet Regression Models ⋮ Minimizing oracle-structured composite functions ⋮ Competitive secant (BFGS) methods based on modified secant relations for unconstrained optimization ⋮ A hybrid HS-LS conjugate gradient algorithm for unconstrained optimization with applications in motion control and image recovery ⋮ Global convergence via modified self-adaptive approach for solving constrained monotone nonlinear equations with application to signal recovery problems ⋮ Computational issues in parameter estimation for hidden Markov models with template model builder ⋮ Estimation and inference by stochastic optimization ⋮ An adaptive projection BFGS method for nonconvex unconstrained optimization problems ⋮ On the Derivation of Quasi-Newton Formulas for Optimization in Function Spaces ⋮ Secant Acceleration of Sequential Residual Methods for Solving Large-Scale Nonlinear Systems of Equations ⋮ Joint coverage probability in a simulation study on continuous-time Markov chain parameter estimation ⋮ Unnamed Item ⋮ On the convergence of quasi-newton methods for nonsmooth problems ⋮ A New Diagonal Quasi-Newton Updating Method With Scaled Forward Finite Differences Directional Derivative for Unconstrained Optimization ⋮ Self-selection and direct estimation of across-regime correlation parameter ⋮ A new accelerated diagonal quasi-Newton updating method with scaled forward finite differences directional derivative for unconstrained optimization ⋮ A derivative-free three-term projection algorithm involving spectral quotient for solving nonlinear monotone equations ⋮ On the Local and Superlinear Convergence of a Parameterized DFP Method ⋮ Oblique projections, Broyden restricted class and limited-memory quasi-Newton methods ⋮ Globally convergent inexact generalized Newton method for first-order differentiable optimization problems ⋮ A BFGS algorithm for solving symmetric nonlinear equations ⋮ Arbitrary Lagrangian-Eulerian formulation for fluid-rigid body interaction ⋮ A modified BFGS method and its global convergence in nonconvex minimization ⋮ Inexact perturbed Newton methods and applications to a class of Krylov solvers ⋮ Consistent tangent matrices for substepping schemes ⋮ Efficiency and implementation of simplicial zero point algorithms ⋮ Convergence analysis of the Levenberg–Marquardt method ⋮ Iterative methods for computing generalized inverses related with optimization methods ⋮ Maintaining factorized KKT systems subject to rank-one updates of Hessians and Jacobians ⋮ Cost approximation algorithms with nonmonotone line searches for a general class of nonlinear programs ⋮ Properties and numerical performance of quasi-Newton methods with modified quasi-Newton equations ⋮ Unnamed Item ⋮ Convergence of the DFP algorithm without exact line search ⋮ Second-order adjoints for solving PDE-constrained optimization problems ⋮ On new iterative method for solving systems of nonlinear equations ⋮ Some theoretical properties of Feng-Schnabel algorithm for block bordered nonlinear systems ⋮ A convergent Newton algorithm for computing Z-eigenvalues of an almost nonnegative irreducible tensor ⋮ Lake Dynamics: Observation and High-Resolution Numerical Simulation ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Inexact Newton methods for the nonlinear complementarity problem ⋮ Towards a parallel component in a GPU–CUDA environment: a case study with the L-BFGS Harwell routine ⋮ Adaptive, Limited-Memory BFGS Algorithms for Unconstrained Optimization ⋮ The Conjugate Residual Method in Linesearch and Trust-Region Methods ⋮ Symmetric minimum-norm updates for use in gibbs free energy calculations ⋮ A modified Newton direction for unconstrained optimization ⋮ OR Practice–Data Analytics for Optimal Detection of Metastatic Prostate Cancer ⋮ A Bregman Forward-Backward Linesearch Algorithm for Nonconvex Composite Optimization: Superlinear Convergence to Nonisolated Local Minima ⋮ Greedy Quasi-Newton Methods with Explicit Superlinear Convergence ⋮ Computationally Efficient Decompositions of Oblique Projection Matrices ⋮ Approximation of Sequences of Symmetric Matrices with the Symmetric Rank-One Algorithm and Applications ⋮ How Many Steps Still Left to $x$*? ⋮ Convergence of quasi-Newton methods for solving constrained generalized equations ⋮ Adjoint-based SQP method with block-wise quasi-Newton Jacobian updates for nonlinear optimal control ⋮ Numerical simulation of tridimensional electromagnetic shaping of liquid metals ⋮ Backward perturbation analysis of certain characteristic subspaces ⋮ Multivariate spectral DY-type projection method for convex constrained nonlinear monotone equations ⋮ Global convergence of the Broyden's class of quasi-Newton methods with nonmonotone linesearch ⋮ Hartley-type algebras in displacement and optimization strategies. ⋮ A regularized limited memory BFGS method for large-scale unconstrained optimization and its efficient implementations ⋮ Adaptive large eddy simulation ⋮ On Davidon's collinear scaling algorithms for optimization ⋮ Forward-backward quasi-Newton methods for nonsmooth optimization problems ⋮ Difference equations and local convergence of inexact Newton methods ⋮ Modifying the BFGS update by a new column scaling technique ⋮ The least prior deviation quasi-Newton update ⋮ Global convergence properties of the modified BFGS method associating with general line search model ⋮ Globally convergent three-term conjugate gradient projection methods for solving nonlinear monotone equations ⋮ A two-piece update of projected Hessian algorithm with nonmonotonic trust region method for constrained optimization ⋮ Interpolation by conic model for unconstrained optimization ⋮ The linear algebra of block quasi-Newton algorithms ⋮ A paradigm for data-driven predictive modeling using field inversion and machine learning ⋮ Parameter estimation in flow through partially saturated porous materials ⋮ The convergence of quasi-Gauss-Newton methods for nonlinear problems ⋮ Hybrid algorithms with automatic switching for solving nonlinear equation systems ⋮ A scalable space-time domain decomposition approach for solving large scale nonlinear regularized inverse ill posed problems in 4D variational data assimilation ⋮ Developments on the Broyden procedure to solve nonlinear problems arising in CFD ⋮ Rates of superlinear convergence for classical quasi-Newton methods ⋮ Variable metric bundle methods: From conceptual to implementable forms ⋮ Modifying the BFGS method ⋮ A modified Dai-Kou-type method with applications to signal reconstruction and blurred image restoration ⋮ A quasi-second-order proximal bundle algorithm ⋮ A new family of preconditioned iterative solvers for nonsymmetric linear systems ⋮ Global convergence of a modified Broyden family method for nonconvex functions

This page was built for publication: Quasi-Newton Methods, Motivation and Theory