Stabilized Barzilai-Borwein method
From MaRDI portal
Abstract: The Barzilai-Borwein (BB) method is a popular and efficient tool for solving large-scale unconstrained optimization problems. Its search direction is the same as for the steepest descent (Cauchy) method, but its stepsize rule is different. Owing to this, it converges much faster than the Cauchy method. A feature of the BB method is that it may generate too long steps, which throw the iterates too far away from the solution. Moreover, it may not converge, even when the objective function is strongly convex. In this paper, a stabilization technique is introduced. It consists in bounding the distance between each pair of successive iterates, which often allows for decreasing the number of BB iterations. When the BB method does not converge, our simple modification of this method makes it convergent. Under suitable assumptions, we prove its global convergence, despite the fact that no line search is involved, and only gradient values are used. Since the number of stabilization steps is proved to be finite, the stabilized version inherits the fast local convergence of the BB method. The presented results of extensive numerical experiments show that our stabilization technique often allows the BB method to solve problems in a fewer iterations, or even to solve problems where the latter fails.
Recommendations
- scientific article; zbMATH DE number 2221955
- On the acceleration of the Barzilai-Borwein method
- The Barzilai and Borwein Gradient Method for the Large Scale Unconstrained Minimization Problem
- Extended Barzilai-Borwein method for unconstrained minimization problems
- R-linear convergence of the Barzilai and Borwein gradient method
Cited in
(31)- On \(R\)-linear convergence analysis for a class of gradient methods
- Two-level optimization approach with accelerated proximal gradient for objective measures in sparse speech reconstruction
- Fast methods for computing centroidal Laguerre tessellations for prescribed volume fractions with applications to microstructure generation of polycrystalline materials
- Stable equilibrium configuration of two bar truss by an efficient nonmonotone global Barzilai-Borwein gradient method in a fuzzy environment
- A family of optimal weighted conjugate-gradient-type methods for strictly convex quadratic minimization
- Feasible Barzilai-Borwein-like methods for extreme symmetric eigenvalue problems
- A modified Cauchy-Barzilai-Borwein method
- Extended Barzilai-Borwein method for unconstrained minimization problems
- Inexact Barzilai-Borwein method for saddle point problems
- Efficient methods for convex problems with Bregman Barzilai-Borwein step sizes
- PACBB: a projected adaptive cyclic Barzilai-Borwein method for box constrained optimization
- scientific article; zbMATH DE number 2221955 (Why is no real title available?)
- Adjoint-based control of three dimensional Stokes droplets
- Adjoint-based optimal control of contractile elastic bodies. Application to limbless locomotion on frictional substrates
- A family of Barzilai-Borwein steplengths from the viewpoint of scaled total least squares
- A structured L-BFGS method and its application to inverse problems
- A novel stepsize for gradient descent method
- Stabilized BB projection algorithm for large-scale convex constrained nonlinear monotone equations to signal and image processing problems
- A stabilized simulated annealing based Barzilai-Borwein method for the solution of unconstrained optimization problems
- Delayed weighted gradient method with simultaneous step-sizes for strongly convex optimization
- A unified derivative-free projection framework for convex-constrained nonlinear equations
- Adaptive proximal algorithms for convex optimization under local Lipschitz continuity of the gradient
- Photon-limited blind image deconvolution with heavy-tailed priors on kernel and noise
- A note on R-linear convergence of nonmonotone gradient methods
- A globalization of L-BFGS and the Barzilai-Borwein method for nonconvex unconstrained optimization
- On Kahan's automatic step-size control and an anadromic gradient descent iteration
- An accelerated primal dual algorithm with backtracking for decentralized constrained optimization
- Regularized Barzilai-Borwein method
- An adaptive stochastic gradient method with variance reduction for smooth optimization problems
- A proximal difference of convex functions algorithm using Barzilai-Borwein step size with nonmonotone line search and extrapolation
- An adaptive stochastic gradient descent algorithm for solving convex optimization problenms
This page was built for publication: Stabilized Barzilai-Borwein method
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5127596)
