Updating Quasi-Newton Matrices with Limited Storage

From MaRDI portal

Publication:3915933

Jump to:navigation, search

DOI10.2307/2006193zbMath0464.65037OpenAlexW4236796448MaRDI QIDQ3915933

Nocedal, Jorge

Publication date: 1980

Full work available at URL: https://doi.org/10.2307/2006193

zbMATH Keywords

numerical experiments preconditioned conjugate gradient methods standard test functions Broyden-Fletcher-Goldfarb-Shanno quasi-Newton update least-change formulas symmetric updates

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Nonlinear programming (90C30) Numerical computation of solutions to systems of equations (65H10)

Related Items

On the use of nonlinear anisotropic diffusion filters for seismic imaging using the full waveform, PFNN-2: A Domain Decomposed Penalty-Free Neural Network Method for Solving Partial Differential Equations, Deep Domain Decomposition Methods: Helmholtz Equation, Optimal Low-rank Approximations of Bayesian Linear Inverse Problems, Quasi-Newton methods for machine learning: forget the past, just sample, QNG: A Quasi-Natural Gradient Method for Large-Scale Statistical Learning, What is observable from wall data in turbulent channel flow?, A Projected Gradient and Constraint Linearization Method for Nonlinear Model Predictive Control, Unnamed Item, A Time-Domain Preconditioned Truncated Newton Approach to Visco-acoustic Multiparameter Full Waveform Inversion, Forward-Backward Envelope for the Sum of Two Nonconvex Functions: Further Properties and Nonmonotone Linesearch Algorithms, Non-asymptotic superlinear convergence of standard quasi-Newton methods, SCORE: approximating curvature information under self-concordant regularization, A hierarchy of spectral relaxations for polynomial optimization, An inexact quasi-Newton algorithm for large-scale \(\ell_1\) optimization with box constraints, Towards global parameter estimation exploiting reduced data sets, Accelerated nonlinear finite element method for analysis of isotropic hyperelastic materials nonlinear deformations, An \(hp\)-adaptive discontinuous Galerkin method for phase field fracture, A numerical approach to the optimal control of thermally convective flows, Optimal sensor placement for variational data assimilation of unsteady flows past a rotationally oscillating cylinder, Regularization of limited memory quasi-Newton methods for large-scale nonconvex minimization, SLISEMAP: supervised dimensionality reduction through local explanations, An overview of stochastic quasi-Newton methods for large-scale machine learning, Globally Convergent Multilevel Training of Deep Residual Networks, Investigating and Mitigating Failure Modes in Physics-Informed Neural Networks (PINNs), A new multipoint symmetric secant method with a dense initial matrix, NAS-PINN: neural architecture search-guided physics-informed neural network for solving PDEs, Addressing discontinuous root-finding for subsequent differentiability in machine learning, inverse problems, and control, Multifidelity Bayesian Experimental Design to Quantify Rare-Event Statistics, SMIwiz: an integrated toolbox for multidimensional seismic modelling and imaging, Randomized Quasi-Newton Updates Are Linearly Convergent Matrix Inversion Algorithms, A regularized limited memory subspace minimization conjugate gradient method for unconstrained optimization, Numerical Approximations of the Allen-Cahn-Ohta-Kawasaki Equation with Modified Physics-Informed Neural Networks (Pinns), A robust BFGS algorithm for unconstrained nonlinear optimization problems, Inexact proximal DC Newton-type method for nonconvex composite functions, An iterative procedure for finding locally and globally optimal arrangements of particles on the unit sphere, Level Set Learning with Pseudoreversible Neural Networks for Nonlinear Dimension Reduction in Function Approximation, A limited-memory BFGS-based differential evolution algorithm for optimal control of nonlinear systems with mixed control variables and probability constraints, Proximal quasi-Newton method for composite optimization over the Stiefel manifold, Memoryless quasi-Newton methods based on the spectral-scaling Broyden family for Riemannian optimization, Spatiotemporal local interpolation of global ocean heat transport using argo floats: a debiased latent Gaussian process approach, A New Type of Variable Preconditioning for a Generalized Minimum Residual Scheme, A graph space optimal transport distance as a generalization of L ^p distances: application to a seismic imaging inverse problem, A hybrid HS-LS conjugate gradient algorithm for unconstrained optimization with applications in motion control and image recovery, Bayesian combinatorial multistudy factor analysis, Transfer Learning of Individualized Treatment Rules from Experimental to Real-World Data, Trust-region algorithms for training responses: machine learning methods using indefinite Hessian approximations, On the global minimum of the classical potential energy for clusters bound by many-body forces, A Class of Approximate Inverse Preconditioners Based on Krylov-Subspace Methods for Large-Scale Nonconvex Optimization, New Basic Hessian Approximations for Large-Scale Nonlinear Least-Squares Optimization, A limited memory BFGS method for a nonlinear inverse problem in digital breast tomosynthesis, A New Diagonal Quasi-Newton Updating Method With Scaled Forward Finite Differences Directional Derivative for Unconstrained Optimization, Unnamed Item, q-Space Novelty Detection with Variational Autoencoders, Krylov space approximate Kalman filtering, A modified Hestense–Stiefel conjugate gradient method close to the memoryless BFGS quasi-Newton method, Optimization Methods for Large-Scale Machine Learning, A subspace limited memory quasi-Newton algorithm for large-scale nonlinear bound constrained optimization, Unnamed Item, Unnamed Item, A family of quasi-Newton methods for unconstrained optimization problems, Quasi-Newton methods: superlinear convergence without line searches for self-concordant functions, Introduction to Supervised Machine Learning for Data Science, On the Foundations and the Applications of Evolutionary Computing, On the optimum support size in meshfree methods: A variational adaptivity approach with maximum-entropy approximants, The Sequential Quadratic Programming Method, A new nonmonotone line search technique for unconstrained optimization, Taylor state dynamos found by optimal control: axisymmetric examples, Linear and nonlinear sensor placement strategies for mean-flow reconstruction via data assimilation, Global multivariate model learning from hierarchically correlated data, Iterative Approximation of Preconditioning Matrices Through Krylov-Type Solver Iterations, A robust multi-batch L-BFGS method for machine learning, An Analysis of a Hybrid Optimization Method for Variational Data Assimilation, A nonmonotone line search for the LBFGS method in parabolic optimal control problems, Adaptive, Limited-Memory BFGS Algorithms for Unconstrained Optimization, An Inexact Variable Metric Proximal Point Algorithm for Generic Quasi-Newton Acceleration, State estimation in turbulent channel flow from limited observations, Simultaneous inversion of shear modulus and traction boundary conditions in biomechanical imaging, Unnamed Item, A dwindling filter line search method for unconstrained optimization, Identification of dipole sources in an elliptic equation from boundary measurements: application to the inverse EEG problem, Smoothing SQP Methods for Solving Degenerate Nonsmooth Constrained Optimization Problems with Applications to Bilevel Programs, QN-like variable storage conjugate gradients, Unnamed Item, Conjugate direction methods with variable storage, Unnamed Item, Large-Scale Optimization with Linear Equality Constraints Using Reduced Compact Representation, Algorithm 943, A three-term CGPM-based algorithm without Lipschitz continuity for constrained nonlinear monotone equations with applications, An efficient neural network method with plane wave activation functions for solving Helmholtz equation, A hybrid approach for finding approximate solutions to constrained nonlinear monotone operator equations with applications, A regularized limited memory BFGS method for large-scale unconstrained optimization and its efficient implementations, Forward-backward quasi-Newton methods for nonsmooth optimization problems, An inverse problem in an elastic domain with a crack: a fictitious domain approach, On obtaining sparse semantic solutions for inverse problems, control, and neural network training, A hybrid FR-DY conjugate gradient algorithm for unconstrained optimization with application in portfolio selection, MIM: a deep mixed residual method for solving high-order partial differential equations, Quadratic serendipity element shape functions on general planar polygons, Reconstruction of unsteady viscous flows using data assimilation schemes, Sequential Bayesian experimental design for estimation of extreme-event probability in stochastic input-to-response systems, Wasserstein Loss for Image Synthesis and Restoration, A hybrid conjugate gradient based approach for solving unconstrained optimization and motion control problems, Limited-memory BFGS with displacement aggregation, A stochastic extra-step quasi-Newton method for nonsmooth nonconvex optimization, An efficient three-dimensional adaptive quasicontinuum method using variable-node elements, A convergent hybrid three-term conjugate gradient method with sufficient descent property for unconstrained optimization, On Efficiently Computing the Eigenvalues of Limited-Memory Quasi-Newton Matrices, On efficiently combining limited-memory and trust-region techniques, Sparse Bayesian deep learning for dynamic system identification, Physics and equality constrained artificial neural networks: application to forward and inverse problems with multi-fidelity data fusion, A modified conjugate gradient method based on the self-scaling memoryless BFGS update, A limited-memory Riemannian symmetric rank-one trust-region method with a restart strategy, Coarse-grained modeling and simulation of graphene sheets based on a discrete hyperelastic approach, A diagonal quasi-Newton updating method for unconstrained optimization, New conjugate gradient algorithms based on self-scaling memoryless Broyden-Fletcher-Goldfarb-Shanno method, A double parameter self-scaling memoryless BFGS method for unconstrained optimization, Preconditioned nonlinear conjugate gradient methods based on a modified secant equation, Lifted discriminative learning of probabilistic logic programs, Limited memory interior point bundle method for large inequality constrained nonsmooth minimization, Full Waveform Inversion and the Truncated Newton Method, A domain-reduction approach to bridging-scale simulation of one-dimensional nanostructures, Energy minimization and preconditioning in the simulation of athermal granular materials in two dimensions, A limited-memory trust-region method for nonlinear optimization with many equality constraints, An implicit gradient-descent procedure for minimax problems, A modified inertial three-term conjugate gradient projection method for constrained nonlinear equations with applications in compressed sensing, A limited memory quasi-Newton approach for multi-objective optimization, Neural network coding of natural images with applications to pure mathematics, Semi-discrete optimal transport: a solution procedure for the unsquared Euclidean distance case, Scaled projected-directions methods with application to transmission tomography, A conjugate directions approach to improve the limited-memory BFGS method, Discrete adjoint of fractional-step incompressible Navier-Stokes solver in curvilinear coordinates and application to data assimilation, An inexact line search approach using modified nonmonotone strategy for unconstrained optimization, A phase-field approach to variational hierarchical surface segmentation, Parallel Optimization Techniques for Machine Learning, Inversion problems for Fourier transforms of particle distributions, A review of nonlinear FFT-based computational homogenization methods, Fast methods for computing centroidal Laguerre tessellations for prescribed volume fractions with applications to microstructure generation of polycrystalline materials, An alternating direction method of multipliers with the BFGS update for structured convex quadratic optimization, On the stability and accuracy of partially and fully implicit schemes for phase field modeling, Some algorithms for the mean curvature flow under topological changes, Novel DCA based algorithms for a special class of nonconvex problems with application in machine learning, Full-space approach to aerodynamic shape optimization, Damped techniques for the limited memory BFGS method for large-scale optimization, A regularized limited memory BFGS method for nonconvex unconstrained minimization, A nonmonotone trust region method based on simple quadratic models, A reduced-space line-search method for unconstrained optimization via random descent directions, Truncated-Newton algorithms for large-scale unconstrained optimization, Some nonlinear conjugate gradient methods based on spectral scaling secant equations, A Newton-like trust region method for large-scale unconstrained nonconvex minimization, Adjoint-state method for hybridizable discontinuous Galerkin discretization, application to the inverse acoustic wave problem, Nonmonotone line searches for unconstrained multiobjective optimization problems, The variational Kalman filter and an efficient implementation using limited memory BFGS, A globally convergent BFGS method for nonlinear monotone equations without any merit functions, Spectral gradient projection method for solving nonlinear monotone equations, Implementing and modifying Broyden class updates for large scale optimization, Exploiting low-rank covariance structures for computing high-dimensional normal and Student-\(t\) probabilities, Constructing high-quality planar NURBS parameterization for isogeometric analysis by adjustment control points and weights, On efficiency of nonmonotone Armijo-type line searches, Bijective parameterization with free boundaries, Exact linesearch limited-memory quasi-Newton methods for minimizing a quadratic function, Composing Scalable Nonlinear Algebraic Solvers, Compact representations of structured BFGS matrices, Discrete-time Zhang neural networks for time-varying nonlinear optimization, Modified three-term conjugate gradient method and its applications, A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications, Geometric Self-Assembly of Rigid Shapes: A Simple Voronoi Approach, Probabilistic inductive constraint logic, A limited memory \(q\)-BFGS algorithm for unconstrained optimization problems, Two limited-memory optimization methods with minimum violation of the previous secant conditions, Preconditioner updates for solving sequences of linear systems in matrix-free environment, Solving unconstrained optimization problems via hybrid CD-DY conjugate gradient methods with applications, Generalized uniformly optimal methods for nonlinear programming, The new spectral conjugate gradient method for large-scale unconstrained optimisation, Jointly robust prior for Gaussian stochastic process in emulation, calibration and variable selection, Computing Eigenvalues of Large Scale Sparse Tensors Arising from a Hypergraph, A new conjugate gradient method with an efficient memory structure, A subspace SQP method for equality constrained optimization, A modified PRP-type conjugate gradient projection algorithm for solving large-scale monotone nonlinear equations with convex constraint, Parallel inexact Newton-Krylov and quasi-Newton solvers for nonlinear elasticity, Shifted limited-memory variable metric methods for large-scale unconstrained optimization, A three term Polak-Ribière-Polyak conjugate gradient method close to the memoryless BFGS quasi-Newton method, A review of the use of optimal transport distances for high resolution seismic imaging based on the full waveform, Adaptive Finite Element Method in Reconstruction of Dielectrics from Backscattered Data, Adaptive FEM with Relaxation for a Hyperbolic Coefficient Inverse Problem, Adaptive three-term family of conjugate residual methods for system of monotone nonlinear equations, A wavelet multi-scale method for the inverse problem of diffuse optical tomography, Diagonal BFGS updates and applications to the limited memory BFGS method, Projective splitting with forward steps, Numerical optimization for the purification of polluted shallow waters, A limited memory quasi-Newton trust-region method for box constrained optimization, An inverse problem in elastography involving Lamé systems, On Hager and Zhang's conjugate gradient method with guaranteed descent, A limited memory BFGS algorithm for non-convex minimization with applications in matrix largest eigenvalue problem, A descent hybrid conjugate gradient method based on the memoryless BFGS update, An unconstrained optimization technique for large-scale linearly constrained convex minimization problems, Multiscale simulation of nanostructures based on spatial secant model: a discrete hyperelastic approach, A data assimilation technique applied to a predator-prey model, A family of three-term nonlinear conjugate gradient methods close to the memoryless BFGS method, A truncated Newton optimization algorithm in meteorology applications with analytic Hessian/vector products, A computational method for full waveform inversion of crosswell seismic data using automatic differentiation, Nonlinear stochastic programming-with a case study in continuous switching, A Barzilai-Borwein conjugate gradient method, Family of projected descent methods for optimization problems with simple bounds, Global convergence of a memory gradient method for unconstrained optimization, Globally convergent limited memory bundle method for large-scale nonsmooth optimization, A compact limited memory method for large scale unconstrained optimization, Inversion study of vertical eddy viscosity coefficient based on an internal tidal model with the adjoint method, An extended nonmonotone line search technique for large-scale unconstrained optimization, Global convergence of a modified limited memory BFGS method for non-convex minimization, Fitting very large sparse Gaussian graphical models, An efficient multigrid strategy for large-scale molecular mechanics optimization, A non-monotone line search algorithm for unconstrained optimization, Descentwise inexact proximal algorithms for smooth optimization, A new regularized limited memory BFGS-type method based on modified secant conditions for unconstrained optimization problems, Limited-memory BFGS systems with diagonal updates, Limited memory methods with improved symmetric rank-one updates and its applications on nonlinear image restoration, On the nonmonotonicity degree of nonmonotone line searches, A quasi-Newton algorithm for nonconvex, nonsmooth optimization with global convergence guarantees, Using approximate secant equations in limited memory methods for multilevel unconstrained optimization, Improved modeling by coupling imperfect models, Some numerical experiments with variable-storage quasi-Newton algorithms, Investigation of the sampling performance of ensemble-based methods with a simple reservoir model, On the limited memory BFGS method for large scale optimization, A review of the optimal power flow, A limited-memory optimization method using the infinitely many times repeated BNS update and conjugate directions, An accelerated subspace minimization three-term conjugate gradient algorithm for unconstrained optimization, Improved optimization methods for image registration problems, Total variation regularization for the reconstruction of a mountain topography, IMAS. Integrated modeling and analysis system for the solution of optimal control problems, A fractal shape optimization problem in branched transport, Sparse quasi-Newton updates with positive definite matrix completion, Nonmonotone Barzilai-Borwein gradient algorithm for \(\ell_1\)-regularized nonsmooth minimization in compressive sensing, On the sufficient descent condition of the Hager-Zhang conjugate gradient methods, A partitioned PSB method for partially separable unconstrained optimization problems, A new hybrid classical-quantum algorithm for continuous global optimization problems, Analysis of sparse quasi-Newton updates with positive definite matrix completion, End-user feature labeling: supervised and semi-supervised approaches based on locally-weighted logistic regression, Discrete second order adjoints in atmospheric chemical transport modeling, Improved constraint-aggregation methods, An adjoint-based Jacobi-type iterative method for elastic full waveform inversion problem, Properties of the block BFGS update and its application to the limited-memory block BNS method for unconstrained minimization, Diagonal bundle method for nonsmooth sparse optimization, Some remarks on conjugate gradient methods without line search, On solving large-scale limited-memory quasi-Newton equations, An approach for analyzing the global rate of convergence of quasi-Newton and truncated-Newton methods, Stochastic gradient descent with Barzilai-Borwein update step for SVM, Novel preconditioners based on quasi-Newton updates for nonlinear conjugate gradient methods, A coordinate gradient descent method for nonsmooth separable minimization, Combining sensitivities and prior information for covariance localization in the ensemble Kalman filter for petroleum reservoir applications, A practical method for solving large-scale TRS, A robust implementation of a sequential quadratic programming algorithm with successive error restoration, Extra-updates criterion for the limited memory BFGS algorithm for large scale nonlinear optimization, An implementation of Newton-like methods on nonlinearly constrained networks, New a posteriori error estimates for adaptivity technique and global convergence for the hyperbolic coefficient inverse problem, MAGMA: inference and prediction using multi-task Gaussian processes with common mean, A multiscale projection method for the analysis of carbon nanotubes, An efficient method for nonlinearly constrained networks, A curvilinear method based on minimal-memory BFGS updates, Scaled Gaussian Stochastic Process for Computer Model Calibration and Prediction, A limited memory steepest descent method, Preconditioned conjugate gradient algorithms for nonconvex problems with box constraints, Some three-term conjugate gradient methods with the inexact line search condition, Robust exponential memory in Hopfield networks, A new three-term conjugate gradient algorithm for unconstrained optimization, Smooth and robust solutions for Dirichlet boundary control of fluid-solid conjugate heat transfer problems, A quasi-Newton method with rank-two update to solve interval optimization problems, Spectral estimation of Hawkes processes from count data, A new Liu-Storey type nonlinear conjugate gradient method for unconstrained optimization problems, A limited memory BFGS-type method for large-scale unconstrained optimization, Fast approximations of shift-variant blur, Concurrent quantum/continuum coupling analysis of nanostructures, A globally and quadratically convergent algorithm with efficient implementation for unconstrained optimization, A conjugate gradient method with sufficient descent property, Optimal control of flow with discontinuities., A comparison of nonlinear optimization methods for supervised learning in multilayer feedforward neural networks, On the resolution of monotone complementarity problems, Hilbert class library: A library of abstract C++ classes for optimization and inversion, The adjoint Newton algorithm for large-scale unconstrained optimization in meteorology applications, 4D large scale variational data assimilation of a turbulent flow with a dynamics error model, A dynamical view of nonlinear conjugate gradient methods with applications to FFT-based computational micromechanics, Symbiosis between linear algebra and optimization, On diagonally-preconditioning the 2-step BFGS method with accumulated steps for linearly constrained nonlinear programming, Variable metric methods for unconstrained optimization and nonlinear least squares, Modifications to the subroutine OPALQP for dealing with large problems, A numerical study of limited memory BFGS methods, Tree approximation for discrete time stochastic processes: a process distance approach, Representations of quasi-Newton matrices and their use in limited memory methods, Optimal control of cylinder wakes via suction and blowing

Uses Software

DRVOCR

Cites Work

Retrieved from "https://portal.mardi4nfdi.de/w/index.php?title=Publication:3915933&oldid=17581434"