Some numerical experiments with variable-storage quasi-Newton algorithms

DOI10.1007/BF01589113zbMath0694.90086OpenAlexW2130844535WikidataQ94868243 ScholiaQ94868243MaRDI QIDQ909585

Claude Lemaréchal, Gilbert, Jean Charles

Publication date: 1989

Published in: Mathematical Programming. Series A. Series B (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/bf01589113

zbMATH Keywords

unconstrained optimizationnumerical experimentsHilbert spacesconjugate gradientdiagonal matrixdiagonal updateslarge-scale modelsRayleigh ellipsoidvariable-metric algorithmsvariable-storage quasi-Newton methods

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Applications of mathematical programming (90C90) Nonlinear programming (90C30) Numerical methods based on necessary conditions (49M05)

Related Items (72)

Solving trajectory optimization problems via nonlinear programming: the brachistochrone case study ⋮ Induction heating processes optimization: A general optimal control approach ⋮ Hessian initialization strategies for \(\ell \)-BFGS solving non-linear inverse problems ⋮ Boundary control of Burgers' equation -- a numerical approach ⋮ An unconstrained optimization technique for large-scale linearly constrained convex minimization problems ⋮ A parallel-in-time multiple shooting algorithm for large-scale PDE-constrained optimal control problems ⋮ Practical global oceanic state estimation ⋮ Boundary conditions control for a shallow-water model ⋮ A data assimilation technique applied to a predator-prey model ⋮ Scaling damped limited-memory updates for unconstrained optimization ⋮ Covariance kernels investigation from diffusive wave equations for data assimilation in hydrology ⋮ An efficient sampling method for stochastic inverse problems ⋮ Sensitivity studies and parameters identification for noisy 3D moving AWJM model ⋮ On efficiently combining limited-memory and trust-region techniques ⋮ Nonmonotone diagonally scaled limited-memory BFGS methods with application to compressive sensing based on a penalty model ⋮ Identification of an optimal derivatives approximation by variational data assimilation ⋮ Globally convergent limited memory bundle method for large-scale nonsmooth optimization ⋮ On the bridge between combinatorial optimization and nonlinear optimization: a family of semidefinite bounds for 0--1 quadratic problems leading to quasi-Newton methods ⋮ Lagrangian data assimilation for river hydraulics simulations ⋮ Inverse rheometry and basal properties inference for pseudoplastic geophysical flows ⋮ Solving \(k\)-cluster problems to optimality with semidefinite programming ⋮ Diagonal approximation of the Hessian by finite differences for unconstrained optimization ⋮ Descentwise inexact proximal algorithms for smooth optimization ⋮ Minimum mutual information and non-Gaussianity through the maximum entropy method: theory and properties ⋮ On the effect of nonlinearity and Jacobian initialization on the convergence of the generalized Broyden quasi‐Newton method ⋮ Gradient trust region algorithm with limited memory BFGS update for nonsmooth convex minimization ⋮ Limited memory interior point bundle method for large inequality constrained nonsmooth minimization ⋮ A restart scheme for the memoryless BFGS method ⋮ Sensitivity of a shallow-water model to parameters ⋮ An active-set projected trust region algorithm for box constrained optimization problems ⋮ New Basic Hessian Approximations for Large-Scale Nonlinear Least-Squares Optimization ⋮ On the limited memory BFGS method for large scale optimization ⋮ Data assimilation for geophysical fluids ⋮ Diagnosis and impacts of non-Gaussianity of innovations in data assimilation ⋮ An accelerated subspace minimization three-term conjugate gradient algorithm for unconstrained optimization ⋮ Computational experiments with scaled initial hessian approximation for the broyden family methods^∗ ⋮ A New Diagonal Quasi-Newton Updating Method With Scaled Forward Finite Differences Directional Derivative for Unconstrained Optimization ⋮ An active set limited memory BFGS algorithm for large-scale bound constrained optimization ⋮ Optimal parameters identification and sensitivity study for abrasive waterjet milling model ⋮ A new accelerated diagonal quasi-Newton updating method with scaled forward finite differences directional derivative for unconstrained optimization ⋮ River discharge and bathymetry estimation from SWOT altimetry measurements ⋮ A compressed-sensing approach for closed-loop optimal control of nonlinear systems ⋮ Optimal control data assimilation with an atmospheric model ⋮ Oblique projections, Broyden restricted class and limited-memory quasi-Newton methods ⋮ A class of diagonal preconditioners for limited memory BFGS method ⋮ Extra-updates criterion for the limited memory BFGS algorithm for large scale nonlinear optimization ⋮ Four-dimensional variational data assimilation for Doppler radar wind data ⋮ A trust-region method applied to parameter identification of a simple prey-predator model ⋮ Stochastic data assimilation of the random shallow water model loads with uncertain experimental measurements ⋮ Gradient constitutive relations: numerical aspects and application to gradient damage ⋮ A proximal subgradient projection algorithm for linearly constrained strictly convex problems ⋮ Adaptive limited memory bundle method for bound constrained large-scale nonsmooth optimization ⋮ Optimal Control and Stochastic Parameter Estimation ⋮ Inverse problem for determining free parameters of a reduced turbulent transport model for tokamak plasma ⋮ A structured quasi-Newton algorithm with nonmonotone search strategy for structured NLS problems and its application in robotic motion control ⋮ A new three-term conjugate gradient algorithm for unconstrained optimization ⋮ Projection Methods in Conic Optimization ⋮ A family of variable metric proximal methods ⋮ The problem of data assimilation for soil water movement ⋮ Optimal boundary discretization by variational data assimilation ⋮ Multiple Schubert’s updating matrix and its compact representation ⋮ On the resolution of monotone complementarity problems ⋮ An Analysis of a Hybrid Optimization Method for Variational Data Assimilation ⋮ The back and forth nudging algorithm applied to a shallow water model, comparison and hybridization with the 4D-VAR ⋮ SINGULARITIES OF STATIONARY SOLUTIONS TO THE VLASOV–POISSON SYSTEM IN A POLYGON ⋮ A \(\mathcal{VU}\)-algorithm for convex minimization ⋮ Variable metric methods for unconstrained optimization and nonlinear least squares ⋮ An active-set projected trust-region algorithm with limited memory BFGS technique for box-constrained nonsmooth equations ⋮ Diagonal BFGS updates and applications to the limited memory BFGS method ⋮ Representations of quasi-Newton matrices and their use in limited memory methods ⋮ Data Assimilation for Geophysical Fluids: The Diffusive Back and Forth Nudging ⋮ On numerical computation of sensitivity of response functions to system inputs in variational data assimilation problems

Uses Software

• L-BFGS
• Unnamed Item

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• On the numerical solution of nonlinear problems in fluid dynamics by least squares and finite element methods. II: Application to transonic flow simulations
• On the limited memory BFGS method for large scale optimization
• Numerical comparison of several variable metric algorithms
• Conjugate Gradient Methods less Dependent on Conjugacy
• QN-like variable storage conjugate gradients
• Algorithm 630
• Global Convergence of a Cass of Quasi-Newton Methods on Convex Problems
• A Relationship between the BFGS and Conjugate Gradient Algorithms and Its Implications for New Algorithms
• Updating Quasi-Newton Matrices with Limited Storage
• Optimal conditioning of self-scaling variable Metric algorithms
• Quasi-Newton Methods, Motivation and Theory
• Matrix conditioning and nonlinear optimization
• A combined conjugate-gradient quasi-Newton minimization algorithm
• Restart procedures for the conjugate gradient method
• Conjugate Gradient Methods with Inexact Searches
• Remark on algorithm 630
• Convergence Conditions for Ascent Methods
• The probability distribution of the magnitude of a structure factor. I. The centrosymmetric crystal

This page was built for publication: Some numerical experiments with variable-storage quasi-Newton algorithms