Two-Point Step Size Gradient Methods

DOI10.1093/imanum/8.1.141zbMath0638.65055OpenAlexW2076605490WikidataQ56935973 ScholiaQ56935973MaRDI QIDQ3779680

Jonathan M. Borwein, Jonathan Barzilai

Publication date: 1988

Published in: IMA Journal of Numerical Analysis (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1093/imanum/8.1.141

zbMATH Keywords

convergencenumerical examplessteepest-descent methodunconstrained minimization secant method

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Nonlinear programming (90C30) Numerical optimization and variational techniques (65K10)

Related Items

A hybrid approach for finding approximate solutions to constrained nonlinear monotone operator equations with applications ⋮ A regularized limited memory BFGS method for large-scale unconstrained optimization and its efficient implementations ⋮ Accelerating mini-batch SARAH by step size rules ⋮ A structure-preserving, operator splitting scheme for reaction-diffusion equations with detailed balance ⋮ An online conjugate gradient algorithm for large-scale data analysis in machine learning ⋮ An accelerated minimal gradient method with momentum for strictly convex quadratic optimization ⋮ A parallel orbital-updating based optimization method for electronic structure calculations ⋮ A new subspace minimization conjugate gradient method based on conic model for large-scale unconstrained optimization ⋮ On initial point selection of the steepest descent algorithm for general quadratic functions ⋮ An extended projected residual algorithm for solving smooth convex optimization problems ⋮ A Newton Frank-Wolfe method for constrained self-concordant minimization ⋮ LMBOPT: a limited memory method for bound-constrained optimization ⋮ A dynamical Tikhonov regularization for solving ill-posed linear algebraic systems ⋮ Nonmonotone spectral method for large-scale symmetric nonlinear equations ⋮ An exact algorithm for graph partitioning ⋮ Fast projections onto mixed-norm balls with applications ⋮ Accelerated linearized Bregman method ⋮ A cyclic projected gradient method ⋮ Linear convergence analysis of the use of gradient projection methods on total variation problems ⋮ Bregman operator splitting with variable stepsize for total variation image reconstruction ⋮ New nonsmooth equations-based algorithms for \(\ell_1\)-norm minimization and applications ⋮ Impulse noise removal by a nonmonotone adaptive gradient method ⋮ Iterative regularization algorithms for constrained image deblurring on graphics processors ⋮ A dual spectral projected gradient method for log-determinant semidefinite problems ⋮ An effective first order reliability method based on Barzilai-Borwein step ⋮ An efficient solution scheme for small-strain crystal-elasto-viscoplasticity in a dual framework ⋮ Projected nonmonotone search methods for optimization with orthogonality constraints ⋮ Stochastic gradient method with Barzilai-Borwein step for unconstrained nonlinear optimization ⋮ Stochastic variance reduced gradient methods using a trust-region-like scheme ⋮ The projected Barzilai-Borwein method with fall-back for strictly convex QCQP problems with separable constraints ⋮ Nonlocal problem for a general second-order elliptic operator ⋮ A simple and feasible method for a class of large-scale \(l^1\)-problems ⋮ Alternating direction multiplier method for matrix \(l_{2,1}\)-norm optimization in multitask feature learning problems ⋮ Global convergence of a modified two-parameter scaled BFGS method with Yuan-Wei-Lu line search for unconstrained optimization ⋮ Steplength selection in gradient projection methods for box-constrained quadratic programs ⋮ Linear multistep methods for optimal control problems and applications to hyperbolic relaxation systems ⋮ A Riemannian conjugate gradient method for optimization on the Stiefel manifold ⋮ Sparse parallel MRI based on accelerated operator splitting schemes ⋮ Some nonlinear conjugate gradient methods based on spectral scaling secant equations ⋮ A nonmonotone PRP conjugate gradient method for solving square and under-determined systems of equations ⋮ Scalar correction method for finding least-squares solutions on Hilbert spaces and its applications ⋮ Analysis of continuous \(H^{-1}\)-least-squares methods for the steady Navier-Stokes system ⋮ A new nonmonotone trust region Barzilai-Borwein method for unconstrained optimization problems ⋮ An accelerated active-set algorithm for a quadratic semidefinite program with general constraints ⋮ Newton's method for the parameterized generalized eigenvalue problem with nonsquare matrix pencils ⋮ Nonisometric surface registration via conformal Laplace-Beltrami basis pursuit ⋮ Optimal control for the Navier-Stokes equation with time delay in the convection: analysis and finite element approximations ⋮ A faster path-based algorithm with Barzilai-Borwein step size for solving stochastic traffic equilibrium models ⋮ An efficient algorithm for joint feature screening in ultrahigh-dimensional Cox's model ⋮ Two adaptive scaled gradient projection methods for Stiefel manifold constrained optimization ⋮ Scaled three-term derivative-free methods for solving large-scale nonlinear monotone equations ⋮ A study on distributed optimization over large-scale networked systems ⋮ A spectral three-term Hestenes-Stiefel conjugate gradient method ⋮ New subspace minimization conjugate gradient methods based on regularization model for unconstrained optimization ⋮ An accelerated first-order method with complexity analysis for solving cubic regularization subproblems ⋮ Compact representations of structured BFGS matrices ⋮ A hybrid three-term conjugate gradient projection method for constrained nonlinear monotone equations with applications ⋮ On DC based methods for phase retrieval ⋮ A Barzilai-Borwein gradient algorithm for spatio-temporal Internet traffic data completion via tensor triple decomposition ⋮ Spectral residual method for nonlinear equations on Riemannian manifolds ⋮ A new descent spectral Polak-Ribière-Polyak method based on the memoryless BFGS update ⋮ Solving nonnegative sparsity-constrained optimization via DC quadratic-piecewise-linear approximations ⋮ On the asymptotic convergence and acceleration of gradient methods ⋮ A computational investigation of the effective viscosity of short-fiber reinforced thermoplastics by an FFT-based method ⋮ Particle-based energetic variational inference ⋮ Solving nonlinear systems of equations via spectral residual methods: stepsize selection and applications ⋮ An alternate gradient method for optimization problems with orthogonality constraints ⋮ The new spectral conjugate gradient method for large-scale unconstrained optimisation ⋮ A Riemannian rank-adaptive method for low-rank matrix completion ⋮ On the inexact scaled gradient projection method ⋮ On \(R\)-linear convergence analysis for a class of gradient methods ⋮ Stabilization of nonautonomous parabolic equations by a single moving actuator ⋮ A modified PRP-type conjugate gradient projection algorithm for solving large-scale monotone nonlinear equations with convex constraint ⋮ Distributed adaptive Huber regression ⋮ The steepest descent of gradient-based iterative method for solving rectangular linear systems with an application to Poisson's equation ⋮ Diagonally scaled memoryless quasi-Newton methods with application to compressed sensing ⋮ Level set of the asymptotic rate of convergence for the method of steepest descent ⋮ A variational approach to Gibbs artifacts removal in MRI ⋮ On the convergence properties of scaled gradient projection methods with non-monotone Armijo-like line searches ⋮ Regularized graph cuts based discrete tomography reconstruction methods ⋮ A Riemannian gradient ascent algorithm with applications to orthogonal approximation problems of symmetric tensors ⋮ Variable metric proximal stochastic variance reduced gradient methods for nonconvex nonsmooth optimization ⋮ An accelerated Sobolev gradient method for unconstrained optimization problems based on variable inner products ⋮ A family of inertial-relaxed DFPM-based algorithms for solving large-scale monotone nonlinear equations with application to sparse signal restoration ⋮ Limited-memory common-directions method for large-scale optimization: convergence, parallelization, and distributed optimization ⋮ A genetic algorithm with a self-reproduction operator to solve systems of nonlinear equations ⋮ A nonmonotone scaled Fletcher-Reeves conjugate gradient method with application in image reconstruction ⋮ Manifold reconstruction and denoising from scattered data in high dimension ⋮ Error estimates for mixed and hybrid FEM for elliptic optimal control problems with penalizations ⋮ A first order reliability method based on hybrid conjugate approach with adaptive Barzilai-Borwein steps ⋮ A class of line search-type methods for nonsmooth convex regularized minimization ⋮ Several accelerated subspace minimization conjugate gradient methods based on regularization model and convergence rate analysis for nonconvex problems ⋮ Structured spectral algorithm with a nonmonotone line search for nonlinear least squares ⋮ Modified optimal Perry conjugate gradient method for solving system of monotone equations with applications ⋮ Hybrid limited memory gradient projection methods for box-constrained optimization problems ⋮ Inertial projection and contraction algorithms with larger step sizes for solving quasimonotone variational inequalities ⋮ On the acceleration of the Barzilai-Borwein method ⋮ Diagonal BFGS updates and applications to the limited memory BFGS method ⋮ Stochastic tensor complementarity problem with discrete distribution ⋮ Mixed and hybrid Petrov-Galerkin finite element discretization for optimal control of the wave equation ⋮ A residual algorithm for finding a fixed point of a nonexpansive mapping ⋮ A nonmonotone spectral projected gradient method for tensor eigenvalue complementarity problems ⋮ Numerical methods for high-dimensional kinetic equations ⋮ Accelerating gradient projection methods for \(\ell _1\)-constrained signal recovery by steplength selection rules ⋮ Hybrid spectral gradient method for the unconstrained minimization problem ⋮ Optimization reformulations of the generalized Nash equilibrium problem using Nikaido-Isoda-type functions ⋮ A convergent least-squares regularized blind deconvolution approach ⋮ Comparison of minimization methods for nonsmooth image segmentation ⋮ Partial spectral projected gradient method with active-set strategy for linearly constrained optimization ⋮ New inexact line search method for unconstrained optimization ⋮ Gradient methods with adaptive step-sizes ⋮ A new descent algorithm using the three-step discretization method for solving unconstrained optimization problems ⋮ A new adaptive Barzilai and Borwein method for unconstrained optimization ⋮ A residual approach for balanced truncation model reduction (BTMR) of compartmental systems ⋮ Simulation of the oxygen distribution in a tumor tissue using residual algorithms ⋮ A globally convergent method for nonlinear least-squares problems based on the Gauss-Newton model with spectral correction ⋮ Constrained optimization with integer and continuous variables using inexact restoration and projected gradients ⋮ Derivative-free method for bound constrained nonlinear monotone equations and its application in solving steady state reaction-diffusion problems ⋮ A positive spectral gradient-like method for large-scale nonlinear monotone equations ⋮ Monotone projected gradient methods for large-scale box-constrained quadratic programming ⋮ A joint matrix minimization approach for multi-image face recognition ⋮ Multiple graphs clustering by gradient flow method ⋮ A Barzilai and Borwein scaling conjugate gradient method for unconstrained optimization problems ⋮ Multiple sparse measurement gradient reconstruction algorithm for DOA estimation in compressed sensing ⋮ A transformation of accelerated double step size method for unconstrained optimization ⋮ A spectral dai-yuan-type conjugate gradient method for unconstrained optimization ⋮ A double-parameter scaling Broyden-Fletcher-Goldfarb-Shanno method based on minimizing the measure function of Byrd and Nocedal for unconstrained optimization ⋮ Spectral projected subgradient with a momentum term for the Lagrangean dual approach ⋮ An extended nonmonotone line search technique for large-scale unconstrained optimization ⋮ A double parameter scaled BFGS method for unconstrained optimization ⋮ Density-based globally convergent trust-region methods for self-consistent field electronic structure calculations ⋮ Receding horizon control for the stabilization of the wave equation ⋮ On optimality of the parameters of self-scaling memoryless quasi-Newton updating formulae ⋮ Numerical solution of huge-scale quasiseparable optimization problems ⋮ Numerical methods for parameter estimation in Poisson data inversion ⋮ A regularized Newton method for computing ground states of Bose-Einstein condensates ⋮ Orbital minimization method with \(\ell^{1}\) regularization ⋮ An inexact alternating directions algorithm for constrained total variation regularized compressive sensing problems ⋮ Efficient nonconvex sparse group feature selection via continuous and discrete optimization ⋮ Nonsmooth spectral gradient methods for unconstrained optimization ⋮ Optimal subgradient algorithms for large-scale convex optimization in simple domains ⋮ A spectral algorithm for large-scale systems of nonlinear monotone equations ⋮ A new steplength selection for scaled gradient methods with application to image deblurring ⋮ \(\ell _p\) regularized low-rank approximation via iterative reweighted singular value minimization ⋮ Shrinking gradient descent algorithms for total variation regularized image denoising ⋮ On the nonmonotonicity degree of nonmonotone line searches ⋮ An accelerated double step size model in unconstrained optimization ⋮ A unified formulation for generalized oilfield development optimization ⋮ Smooth and adaptive gradient method with retards ⋮ Optimization methods for regularization-based ill-posed problems: a survey and a multi-objective framework ⋮ Multi-step spectral gradient methods with modified weak secant relation for large scale unconstrained optimization ⋮ A structured diagonal Hessian approximation method with evaluation complexity analysis for nonlinear least squares ⋮ Quadratic regularization projected Barzilai-Borwein method for nonnegative matrix factorization ⋮ A modified scaled memoryless BFGS preconditioned conjugate gradient algorithm for nonsmooth convex optimization ⋮ Accelerated double direction method for solving unconstrained optimization problems ⋮ On the solution of the symmetric eigenvalue complementarity problem by the spectral projected gradient algorithm ⋮ Nonmonotone adaptive Barzilai-Borwein gradient algorithm for compressed sensing ⋮ A new method with sufficient descent property for unconstrained optimization ⋮ A numerical study of applying spectral-step subgradient method for solving nonsmooth unconstrained optimization problems ⋮ Flow search approach and new bounds for the \(m\)-step linear conjugate gradient algorithm ⋮ Efficient projected gradient methods for cardinality constrained optimization ⋮ Recent results on assigned and unassigned distance geometry with applications to protein molecules and nanostructures ⋮ An efficient Barzilai-Borwein conjugate gradient method for unconstrained optimization ⋮ Prediction-correction method with BB step sizes ⋮ A derivative-free nonmonotone line-search technique for unconstrained optimization ⋮ A note on a multiplicative parameters gradient method ⋮ A cyclic block coordinate descent method with generalized gradient projections ⋮ A block active set algorithm with spectral choice line search for the symmetric eigenvalue complementarity problem ⋮ Spectral projected gradient methods for generalized tensor eigenvalue complementarity problems ⋮ Reducing effects of bad data using variance based joint sparsity recovery ⋮ Multivariate spectral gradient method for unconstrained optimization ⋮ Some remarks on conjugate gradient methods without line search ⋮ A new derivative-free SCG-type projection method for nonlinear monotone equations with convex constraints ⋮ On a scalable nonparametric denoising of time series signals ⋮ Stochastic gradient descent with Barzilai-Borwein update step for SVM ⋮ An efficient gradient method with approximate optimal stepsize for large-scale unconstrained optimization ⋮ Acceleration of the EM algorithm via extrapolation methods: review, comparison and new methods ⋮ Accumulative approach in multistep diagonal gradient-type method for large-scale unconstrained optimization ⋮ A globally convergent derivative-free method for solving large-scale nonlinear monotone equations ⋮ A PRP type method for systems of monotone equations ⋮ Augmented Lagrangian algorithms based on the spectral projected gradient method for solving nonlinear programming problems ⋮ Projected Barzilai-Borwein methods for large-scale box-constrained quadratic programming ⋮ Notes on the Dai-Yuan-Yuan modified spectral gradient method ⋮ A new family of conjugate gradient methods for unconstrained optimization ⋮ On nonmonotone Chambolle gradient projection algorithms for total variation image restoration ⋮ Reconstruction of 3D X-ray CT images from reduced sampling by a scaled gradient projection algorithm ⋮ A nonmonotone gradient algorithm for total variation image denoising problems ⋮ An affine-scaling interior-point CBB method for box-constrained optimization ⋮ Subspace Barzilai-Borwein gradient method for large-scale bound constrained optimization ⋮ A maxentropic procedure for reconstructing a distribution from its marginals ⋮ A new gradient method via quasi-Cauchy relation which guarantees descent ⋮ Linear reconstruction problems with convex constraints: Influence of the a priori data ⋮ Greatest descent algorithms in unconstrained optimization ⋮ A modified bat algorithm with conjugate gradient method for global optimization ⋮ Impulse noise removal by an adaptive trust-region method ⋮ A descent algorithm without line search for unconstrained optimization ⋮ A dynamical view of nonlinear conjugate gradient methods with applications to FFT-based computational micromechanics ⋮ Nonlinear orthomin\((k)\) methods ⋮ Convergence of descent method with new line search ⋮ Biorthogonal vector sequence transformations and Padé approximation of vector series ⋮ On the regularizing behavior of the SDA and SDC gradient methods in the solution of linear ill-posed problems ⋮ On the application of the spectral projected gradient method in image segmentation ⋮ Algorithms that satisfy a stopping criterion, probably ⋮ On Hager and Zhang's conjugate gradient method with guaranteed descent ⋮ An augmented Lagrangian method for binary quadratic programming based on a class of continuous functions ⋮ A Barzilai-Borwein-like iterative half thresholding algorithm for the \(L_{1/2}\) regularized problem ⋮ On some steplength approaches for proximal algorithms ⋮ A smoothing SQP framework for a class of composite \(L_q\) minimization over polyhedron ⋮ Projection algorithms for nonconvex minimization with application to sparse principal component analysis ⋮ On the global convergence rate of the gradient descent method for functions with Hölder continuous gradients ⋮ A gradient-based method for atmospheric tomography ⋮ Local analysis of a spectral correction for the Gauss-Newton model applied to quadratic residual problems ⋮ A Barzilai-Borwein conjugate gradient method ⋮ Non-monotone algorithm for minimization on arbitrary domains with applications to large-scale orthogonal Procrustes problem ⋮ A new nonmonotone spectral residual method for nonsmooth nonlinear equations ⋮ On the worst case performance of the steepest descent algorithm for quadratic functions ⋮ Expectation propagation for nonlinear inverse problems -- with an application to electrical impedance tomography ⋮ Dynamic multi-source X-ray tomography using a spacetime level set method ⋮ Computationally efficient approach for the minimization of volume constrained vector-valued Ginzburg-Landau energy functional ⋮ Modified subspace Barzilai-Borwein gradient method for non-negative matrix factorization ⋮ An asymptotically optimal gradient algorithm for quadratic optimization with low computational cost ⋮ Use of the minimum norm search direction in a nonmonotone version of the Gauss-Newton method ⋮ Inverse determination of a heat source from natural convection in a porous cavity ⋮ Accelerated Bregman method for linearly constrained \(\ell _1-\ell _2\) minimization ⋮ Scaling on the spectral gradient method ⋮ Two derivative-free projection approaches for systems of large-scale nonlinear monotone equations ⋮ Scaled diagonal gradient-type method with extra update for large-scale unconstrained optimization ⋮ ParNes: A rapidly convergent algorithm for accurate recovery of sparse and approximately sparse signals ⋮ A new two-step gradient-type method for large-scale unconstrained optimization ⋮ Spectral scaling BFGS method ⋮ Estimation of spectral bounds in gradient algorithms ⋮ Two-step version of fixed point continuation method for sparse reconstruction ⋮ Two modified scaled nonlinear conjugate gradient methods ⋮ A simple sufficient descent method for unconstrained optimization ⋮ Duality-based algorithms for total-variation-regularized image restoration ⋮ Spatio-temporal random fields: compressible representation and distributed estimation ⋮ Nonmonotone algorithm for minimization on closed sets with applications to minimization on Stiefel manifolds ⋮ Operator splittings, Bregman methods and frame shrinkage in image processing ⋮ Gradient algorithms for quadratic optimization with fast convergence rates ⋮ Preconditioning non-monotone gradient methods for retrieval of seismic reflection signals ⋮ A modified conjugate gradient algorithm with cyclic Barzilai-Borwein steplength for unconstrained optimization ⋮ A Barzilai-Borwein-based heuristic algorithm for locating multiple facilities with regional demand ⋮ Implementation of an optimal first-order method for strongly convex total variation regularization ⋮ Modified active set projected spectral gradient method for bound constrained optimization ⋮ An improved multi-step gradient-type method for large scale optimization ⋮ Global convergence of a spectral conjugate gradient method for unconstrained optimization ⋮ Hybrid regularization methods for seismic reflectivity inversion ⋮ Two effective hybrid conjugate gradient algorithms based on modified BFGS updates ⋮ A note on the global convergence theorem of the scaled conjugate gradient algorithms proposed by Andrei ⋮ Geometric interpretation of some Cauchy related methods ⋮ The chaotic nature of faster gradient descent methods ⋮ A new analysis on the Barzilai-Borwein gradient method ⋮ Folding-free global conformal mapping for genus-0 surfaces by harmonic energy minimization ⋮ Iterative hard thresholding methods for \(l_0\) regularized convex cone programming ⋮ Iterative reweighted minimization methods for \(l_p\) regularized unconstrained nonlinear programming ⋮ Linear convergence of a type of iterative sequences in nonconvex quadratic programming ⋮ Scalar correction method for solving large scale unconstrained minimization problems ⋮ Nonmonotone Barzilai-Borwein gradient algorithm for \(\ell_1\)-regularized nonsmooth minimization in compressive sensing ⋮ An efficient gradient method using the Yuan steplength ⋮ Adaptive choice of the Tikhonov regularization parameter to solve ill-posed linear algebraic equations via Liapunov optimizing control ⋮ A Barzilai-Borwein type method for stochastic linear complementarity problems ⋮ A new generalized shrinkage conjugate gradient method for sparse recovery ⋮ A feasible filter method for the nearest low-rank correlation matrix problem ⋮ A Barzilai-Borwein type method for minimizing composite functions ⋮ A modified Perry's conjugate gradient method-based derivative-free method for solving large-scale nonlinear monotone equations ⋮ Norm descent conjugate gradient methods for solving symmetric nonlinear equations ⋮ Spectral gradient method for impulse noise removal ⋮ A nonmonotone line search method for noisy minimization ⋮ A class of diagonal quasi-Newton methods for large-scale convex minimization ⋮ Obituary: Jonathan M. Borwein (1951--2016). Homo sapiens, homo ludens ⋮ A new modified Barzilai-Borwein gradient method for the quadratic minimization problem ⋮ Computing the generalized eigenvalues of weakly symmetric tensors ⋮ A computation study on an integrated alternating direction method of multipliers for large scale optimization ⋮ An adaptive scaled BFGS method for unconstrained optimization ⋮ A limited memory descent Perry conjugate gradient method ⋮ The matrix pencil nearness problem in structural dynamic model updating ⋮ A Kronecker approximation with a convex constrained optimization method for blind image restoration ⋮ A hybrid ODE-based method for unconstrained optimization problems ⋮ Modified nonmonotone Armijo line search for descent method ⋮ Convex constrained optimization for large-scale generalized Sylvester equations ⋮ A practical method for solving large-scale TRS ⋮ Non-smooth equations based method for \(\ell_1\)-norm problems with applications to compressed sensing ⋮ Applying powell's symmetrical technique to conjugate gradient methods ⋮ Feasible smooth method based on Barzilai-Borwein method for stochastic linear complementarity problem ⋮ An implicit preconditioning strategy for large-scale generalized Sylvester equations ⋮ Large correlation analysis ⋮ A box constrained gradient projection algorithm for compressed sensing ⋮ A feasible method for optimization with orthogonality constraints ⋮ A residual method for solving nonlinear operator equations and their application to nonlinear integral equations using symbolic computation ⋮ Convergence properties of nonmonotone spectral projected gradient methods ⋮ Residual methods for the large-scale matrix \(p\)th root and some related problems ⋮ A curvilinear method based on minimal-memory BFGS updates ⋮ An augmented Lagrangian approach for sparse principal component analysis ⋮ A limited memory steepest descent method ⋮ An approach based on dwindling filter method for positive definite generalized eigenvalue problem ⋮ Variational Bayesian strategies for high-dimensional, stochastic design problems ⋮ An affine scaling method for optimization problems with polyhedral constraints ⋮ A framework of constraint preserving update schemes for optimization on Stiefel manifold ⋮ Some projection methods with the BB step sizes for variational inequalities ⋮ Nomonotone spectral gradient method for sparse recovery ⋮ A class of descent four-term extension of the Dai-Liao conjugate gradient method based on the scaled memoryless BFGS update ⋮ A memory gradient method based on the nonmonotone technique ⋮ A trust region spectral method for large-scale systems of nonlinear equations ⋮ Large sparse signal recovery by conjugate gradient algorithm based on smoothing technique ⋮ Barzilai and Borwein's method for multiobjective optimization problems ⋮ A new approach to improve ill-conditioned parabolic optimal control problem via time domain decomposition ⋮ An efficient augmented Lagrangian method with applications to total variation minimization ⋮ Nonmonotone derivative-free methods for nonlinear equations ⋮ Implicit and adaptive inverse preconditioned gradient methods for nonlinear problems ⋮ Steepest descent method with random step lengths ⋮ Regularization and numerical solution of the inverse scattering problem using shearlet frames ⋮ A proximal iteratively regularized Gauss-Newton method for nonlinear inverse problems ⋮ Trace-penalty minimization for large-scale eigenspace computation ⋮ Computing extreme eigenvalues of large scale Hankel tensors ⋮ Runge-Kutta-like scaling techniques for first-order methods in convex optimization ⋮ Hybrid nonmonotone spectral gradient method for the unconstrained minimization problem ⋮ An active set Newton-CG method for \(\ell_1\) optimization ⋮ A modulus-based nonmonotone line search method for nonlinear complementarity problems ⋮ Nonmonotone inexact restoration approach for minimization with orthogonality constraints ⋮ The modified accelerated Bregman method for regularized basis pursuit problem ⋮ Several efficient gradient methods with approximate optimal stepsizes for large scale unconstrained optimization ⋮ Sparsity-promoting optimal control of systems with symmetries, consensus and synchronization networks ⋮ Cooperative concurrent asynchronous computation of the solution of symmetric linear systems ⋮ An engineering interpretation of Nesterov's convex minimization algorithm and time integration: application to optimal fiber orientation ⋮ Feature selection using stochastic approximation with Barzilai and Borwein non-monotone gains ⋮ Accelerating the gradient projection algorithm for solving the non-additive traffic equilibrium problem with the Barzilai-Borwein step size ⋮ A derivative-free multivariate spectral projection algorithm for constrained nonlinear monotone equations ⋮ A new subspace minimization conjugate gradient method with nonmonotone line search for unconstrained optimization ⋮ Sparse variational Bayesian approximations for nonlinear inverse problems: applications in nonlinear elastography ⋮ A descent Dai-Liao conjugate gradient method for nonlinear equations ⋮ A family of optimal weighted conjugate-gradient-type methods for strictly convex quadratic minimization ⋮ Implicit steepest descent algorithm for optimization with orthogonality constraints ⋮ Cubic regularization methods with second-order complexity guarantee based on a new subproblem reformulation ⋮ Adaptive \(l_1\)-regularization for short-selling control in portfolio selection ⋮ Inexact alternating direction methods of multipliers for separable convex optimization ⋮ A semismooth Newton method for support vector classification and regression ⋮ The Uzawa-MBB type algorithm for nonsymmetric saddle point problems ⋮ A new inertial-based method for solving pseudomonotone operator equations with application ⋮ Structured two-point stepsize gradient methods for nonlinear least squares ⋮ An efficient gradient method with approximately optimal stepsize based on tensor model for unconstrained optimization ⋮ A nonsmooth regularization approach based on shearlets for Poisson noise removal in ROI tomography ⋮ On the steplength selection in gradient methods for unconstrained optimization ⋮ Partial convolution for total variation deblurring and denoising by new linearized alternating direction method of multipliers with extension step ⋮ Smoothed quantile regression with large-scale inference ⋮ Composite SAR imaging using sequential joint sparsity ⋮ An exact penalty approach for optimization with nonnegative orthogonality constraints ⋮ Sparsity reconstruction in electrical impedance tomography: an experimental evaluation ⋮ Shape optimization for tumor location ⋮ A proximal quasi-Newton method based on memoryless modified symmetric rank-one formula ⋮ The partially symmetric rank-1 approximation of fourth-order partially symmetric tensors ⋮ A harmonic framework for stepsize selection in gradient methods ⋮ A modified scaled memoryless BFGS preconditioned conjugate gradient method for unconstrained optimization ⋮ Lifetime dependence modelling using a truncated multivariate gamma distribution ⋮ A customized Douglas-Rachford splitting algorithm for separable convex minimization with linear constraints ⋮ Gradient methods for computing the Drazin-inverse solution ⋮ Convergence of supermemory gradient method ⋮ An improved gradient projection-based decomposition technique for support vector machines ⋮ Scaled conjugate gradient algorithms for unconstrained optimization ⋮ Structured minimal-memory inexact quasi-Newton method and secant preconditioners for augmented Lagrangian optimization ⋮ On the asymptotic behaviour of some new gradient methods ⋮ On step-size estimation of line search methods ⋮ New algorithms for singly linearly constrained quadratic programs subject to lower and upper bounds ⋮ Asymptotic behaviour of a family of gradient algorithms in \(\mathbb R^{ d }\) and Hilbert spaces ⋮ On memory gradient method with trust region for unconstrained optimization ⋮ Spectral gradient projection method for solving nonlinear monotone equations ⋮ Large-Scale Inverse Problems in Imaging ⋮ Optimization-based Shrinking Dimer Method for Finding Transition States ⋮ Barzilai–Borwein method with variable sample size for stochastic linear complementarity problems ⋮ A new gradient method with an optimal stepsize property ⋮ Faster gradient descent and the efficient recovery of images ⋮ Successive unconstrained dual optimization method for~rank-one approximation to tensors ⋮ A globally optimal tri-vector method to solve an ill-posed linear system ⋮ Recovery of the local volatility function using regularization and a gradient projection method ⋮ Barzilai-Borwein-like methods for the extreme eigenvalue problem ⋮ A family of three-term conjugate gradient methods with sufficient descent property for unconstrained optimization ⋮ An alternating direction method for solving a class of inverse semi-definite quadratic programming problems ⋮ Distributed and consensus optimization for non-smooth image reconstruction ⋮ An alternating direction approximate Newton algorithm for ill-conditioned inverse problems with application to parallel MRI ⋮ A parallel line search subspace correction method for composite convex optimization ⋮ A new nonmonotone filter Barzilai–Borwein method for solving unconstrained optimization problems ⋮ An $\mathcal O(1/{k})$ Convergence Rate for the Variable Stepsize Bregman Operator Splitting Algorithm ⋮ A family of derivative-free conjugate gradient methods for large-scale nonlinear systems of equations ⋮ On the Stabilizability of the Burgers Equation by Receding Horizon Control ⋮ Low-Rank Spectral Optimization via Gauge Duality ⋮ An efficient optimization approach for a cardinality-constrained index tracking problem ⋮ A projected gradient method for optimization over density matrices ⋮ A coordinate descent homotopy method for linearly constrained nonsmooth convex minimization ⋮ A sufficient descent conjugate gradient method and its global convergence ⋮ Scaling Techniques for $\epsilon$-Subgradient Methods ⋮ Projection onto a Polyhedron that Exploits Sparsity ⋮ A Variable Metric Forward-Backward Method with Extrapolation ⋮ $L_p$-norm Regularization Algorithms for Optimization Over Permutation Matrices ⋮ Computing Eigenvalues of Large Scale Sparse Tensors Arising from a Hypergraph ⋮ Preconditioned Barzilai-Borwein method for the numerical solution of partial differential equations ⋮ New iterative schemes for nonlinear fixed point problems, with applications to problems with bifurcations and incomplete-data problems ⋮ Spectral gradient methods for linearly constrained optimization ⋮ Convergence of descent method without line search ⋮ Differential equations and solution of linear systems ⋮ Feasible Barzilai–Borwein-like methods for extreme symmetric eigenvalue problems ⋮ A non-monotonic method for large-scale non-negative least squares ⋮ Multivariate spectral DY-type projection method for convex constrained nonlinear monotone equations ⋮ A two-stage active-set algorithm for bound-constrained optimization ⋮ A new simple model trust-region method with generalized Barzilai-Borwein parameter for large-scale optimization ⋮ A secant-based Nesterov method for convex functions ⋮ Stable equilibrium configuration of two bar truss by an efficient nonmonotone global Barzilai-Borwein gradient method in a fuzzy environment ⋮ Novel algorithms for noisy minimization problems with applications to neural networks training ⋮ Smoothing projected Barzilai-Borwein method for constrained non-Lipschitz optimization ⋮ Comparison of active-set and gradient projection-based algorithms for box-constrained quadratic programming ⋮ An extended delayed weighted gradient algorithm for solving strongly convex optimization problems ⋮ Riemannian conjugate gradient methods for computing the extreme eigenvalues of symmetric tensors ⋮ Nonmonotone diagonally scaled limited-memory BFGS methods with application to compressive sensing based on a penalty model ⋮ Nonmonotone spectral gradient method based on memoryless symmetric rank-one update for large-scale unconstrained optimization ⋮ A new smoothing spectral conjugate gradient method for solving tensor complementarity problems ⋮ A hybrid quasi-Newton projected-gradient method with application to lasso and basis-pursuit denoising ⋮ A Riemannian optimization approach for solving the generalized eigenvalue problem for nonsquare matrix pencils ⋮ A note on the spectral gradient projection method for nonlinear monotone equations with applications ⋮ Subsampled nonmonotone spectral gradient methods ⋮ Separating variables to accelerate non-convex regularized optimization ⋮ On the global convergence of an inexact quasi-Newton conditional gradient method for constrained nonlinear systems ⋮ Analysis of the Barzilai-Borwein step-sizes for problems in Hilbert spaces ⋮ Two-point step size gradient method for solving a deep learning problem ⋮ A modified scaled memoryless symmetric rank-one method ⋮ Fast gradient methods with alignment for symmetric linear systems without using Cauchy step ⋮ Effective algorithms for solving trace minimization problem in multivariate statistics ⋮ Discrete processes and their continuous limits ⋮ Phase retrieval: a data-driven wavelet frame based approach ⋮ Adaptive decomposition-based evolutionary approach for multiobjective sparse reconstruction ⋮ Effective zero-norm minimization algorithms for noisy compressed sensing ⋮ A new subspace minimization conjugate gradient method based on modified secant equation for unconstrained optimization ⋮ Optimal non-negative forecast reconciliation ⋮ A gradient descent method for solving a system of nonlinear equations ⋮ A family of modified spectral projection methods for nonlinear monotone equations with convex constraint ⋮ Optimization for deep learning: an overview ⋮ Scaled projected-directions methods with application to transmission tomography ⋮ A survey of gradient methods for solving nonlinear optimization ⋮ Variable metric techniques for forward-backward methods in imaging ⋮ Efficient algorithms for solving condition number-constrained matrix minimization problems ⋮ Approximating the cumulant generating function of triangles in the Erdös-Rényi random graph ⋮ A new projected Barzilai-Borwein method for the symmetric cone complementarity problem ⋮ New stepsizes for the gradient method ⋮ A linearly convergent stochastic recursive gradient method for convex optimization ⋮ Accelerated diagonal gradient-type method for large-scale unconstrained optimization ⋮ Cayley-transform-based gradient and conjugate gradient algorithms on Grassmann manifolds ⋮ On the superiority of PGMs to PDCAs in nonsmooth nonconvex sparse regression ⋮ A Barzilai and Borwein regularization feasible direction algorithm for convex nonlinear SOC programming with linear constraints ⋮ A class of accelerated subspace minimization conjugate gradient methods ⋮ A review of nonlinear FFT-based computational homogenization methods ⋮ Fast methods for computing centroidal Laguerre tessellations for prescribed volume fractions with applications to microstructure generation of polycrystalline materials ⋮ A relaxed interior point method for low-rank semidefinite programming problems with applications to matrix completion ⋮ A second-order gradient method for convex minimization ⋮ Solving the discrete Euler-Arnold equations for the generalized rigid body motion ⋮ An alternating nonmonotone projected Barzilai-Borwein algorithm of nonnegative factorization of big matrices ⋮ Fused Lasso approach in portfolio selection ⋮ One-bit tensor completion via transformed tensor singular value decomposition ⋮ Analysis of the maximum magnification by the scaled memoryless DFP updating formula with application to compressive sensing ⋮ Using gradient directions to get global convergence of Newton-type methods ⋮ Improved SVRG for finite sum structure optimization with application to binary classification ⋮ A new spectral method for \(l_1\)-regularized minimization ⋮ A double-projection-based algorithm for large-scale nonlinear systems of monotone equations ⋮ A conjugate gradient method to solve convex constrained monotone equations with applications in compressive sensing ⋮ Asymptotic rate of convergence of a two-layer iterative method of the variational type ⋮ Two spectral gradient projection methods for constrained equations and their linear convergence rate ⋮ Nonmonotone adaptive trust region method with line search based on new diagonal updating ⋮ Spectral gradient projection method for monotone nonlinear equations with convex constraints ⋮ A modified conjugate gradient method for monotone nonlinear equations with convex constraints ⋮ An efficient nonmonotone adaptive cubic regularization method with line search for unconstrained optimization problem ⋮ A family of Hager-Zhang conjugate gradient methods for system of monotone nonlinear equations ⋮ A penalty decomposition method for rank minimization problem with affine constraints ⋮ Exact spectral-like gradient method for distributed optimization ⋮ A delayed weighted gradient method for strictly convex quadratic minimization ⋮ ACQUIRE: an inexact iteratively reweighted norm approach for TV-based Poisson image restoration ⋮ On efficiency of nonmonotone Armijo-type line searches ⋮ Spectral modified Polak-Ribiére-Polyak projection conjugate gradient method for solving monotone systems of nonlinear equations ⋮ A class of derivative-free CG projection methods for nonsmooth equations with an application to the LASSO problem ⋮ Robust finite mixture regression for heterogeneous targets ⋮ An accelerated version of alternating direction method of multipliers for TV minimization in EIT ⋮ On sparse beamformer design with reverberation ⋮ A global hybrid derivative-free method for high-dimensional systems of nonlinear equations ⋮ An improved Dai-Kou conjugate gradient algorithm for unconstrained optimization ⋮ Numerical construction of spherical \(t\)-designs by Barzilai-Borwein method ⋮ A proximal regularized Gauss-Newton-Kaczmarz method and its acceleration for nonlinear ill-posed problems ⋮ An active set Barzilar-Borwein algorithm for \(l_0\) regularized optimization ⋮ On matrix exponentials and their approximations related to optimization on the Stiefel manifold ⋮ Joint image formation and two-dimensional autofocusing for synthetic aperture radar data ⋮ Global optimization with orthogonality constraints via stochastic diffusion on manifold ⋮ A modified spectral conjugate gradient method with global convergence ⋮ Matrix forms of iterative algorithms to solve large-scale discrete ill-posed problems with an application to image restoration ⋮ A subspace minimization conjugate gradient method based on conic model for unconstrained optimization ⋮ Accelerated augmented Lagrangian method for total variation minimization ⋮ A family of spectral gradient methods for optimization ⋮ Scaled nonlinear conjugate gradient methods for nonlinear least squares problems ⋮ Convergence analysis of a nonmonotone projected gradient method for multiobjective optimization problems ⋮ A software framework for embedded nonlinear model predictive control using a gradient-based augmented Lagrangian approach (GRAMPC) ⋮ A novel approach for solving semidefinite programs ⋮ An efficient monotone projected Barzilai-Borwein method for nonnegative matrix factorization ⋮ A modified spectral conjugate gradient projection algorithm for total variation image restoration ⋮ A flexible inexact-restoration method for constrained optimization ⋮ Two maxentropic approaches to determine the probability density of compound risk losses ⋮ Semi-supervised learning with nuclear norm regularization ⋮ Convergence analysis for the modified spectral projected subgradient method ⋮ An efficient nonmonotone projected Barzilai–Borwein method for nonnegative matrix factorization with extrapolation ⋮ A trust region method with project step for bound constrained optimization without compact condition ⋮ A self-singularity-capturing scheme for fractional differential equations ⋮ A new subspace minimization conjugate gradient method based on tensor model for unconstrained optimization ⋮ Inexact variable metric method for convex-constrained optimization problems ⋮ Derivative-Free Bayesian Inversion Using Multiscale Dynamics ⋮ On the complexity of solving feasibility problems with regularized models ⋮ Computational experience with numerical methods for nonnegative least-squares problems ⋮ Transition pathways in Cylinder-Gyroid interface ⋮ LEARNING AN ADAPTIVE DICTIONARY USING A PROJECTED GRADIENT METHOD AND ITS APPLICATION ON IMAGE DE-NOISING ⋮ A reconstruction algorithm for electrical impedance tomography based on sparsity regularization ⋮ Convergence properties of inexact projected gradient methods ⋮ On the convergence of an active-set method for ℓ₁minimization ⋮ Sparse signal recovery by accelerated ℓ_q (0<q<1) thresholding algorithm ⋮ On the semi-global stabilizability of the Korteweg-de Vries Equationviamodel predictive control ⋮ On the Barzilai–Borwein gradient methods with structured secant equation for nonlinear least squares problems ⋮ Data-driven distributionally robust risk parity portfolio optimization ⋮ Improved high-dimensional regression models with matrix approximations applied to the comparative case studies with support vector machines ⋮ On the rate of convergence of projected Barzilai–Borwein methods ⋮ A Positive Barzilai–Borwein-Like Stepsize and an Extension for Symmetric Linear Systems ⋮ Iterative Methods for the Elastography Inverse Problem of Locating Tumors ⋮ A vectorial descent stepsize for parameter identification of a coupled parabolic PDE-ODE ⋮ A modified quasi‐Newton diagonal update algorithm for total variation denoising problems and nonlinear monotone equations with applications in compressive sensing ⋮ ON TIKHONOV REGULARIZATION AND COMPRESSIVE SENSING FOR SEISMIC SIGNAL PROCESSING ⋮ Patch-Based Image Restoration Using Expectation Propagation ⋮ On the convergence rate of scaled gradient projection method ⋮ A diagonal quasi-Newton updating method based on minimizing the measure function of Byrd and Nocedal for unconstrained optimization ⋮ Projected gradient algorithms for optimization over order simplices ⋮ New conjugate gradient-like methods for unconstrained optimization ⋮ A nonmonotone ODE-based method for unconstrained optimization ⋮ A double optimal descent algorithm for iteratively solving ill-posed linear inverse problems ⋮ Optimal Control for Two-Phase Flows ⋮ Benchmarking large-scale distributed convex quadratic programming algorithms ⋮ Maximum entropy and feasibility methods for convex and nonconvex inverse problems ⋮ Using Krylov subspace and spectral methods for solving complementarity problems in many-body contact dynamics simulation ⋮ An Augmented Lagrangian Method for Non-Lipschitz Nonconvex Programming ⋮ A Randomized Nonmonotone Block Proximal Gradient Method for a Class of Structured Nonlinear Programming ⋮ Unnamed Item ⋮ On iterative algorithms for quantitative photoacoustic tomography in the radiative transport regime ⋮ A scaled nonlinear conjugate gradient algorithm for unconstrained optimization ⋮ A New First-Order Algorithmic Framework for Optimization Problems with Orthogonality Constraints ⋮ Randomized algorithms for high quality treatment planning in volumetric modulated arc therapy ⋮ Gradient-based method with active set strategy for $\ell _1$ optimization ⋮ Approximate norm descent methods for constrained nonlinear systems ⋮ Convergence of memory gradient methods ⋮ Sparsity and level set regularization for diffuse optical tomography using a transport model in 2D ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Shearlet-based regularized reconstruction in region-of-interest computed tomography ⋮ A non-monotone linear search algorithm with mixed direction on Stiefel manifold ⋮ Spectral conjugate gradient methods with sufficient descent property for large-scale unconstrained optimization ⋮ On the Use of ADMM for Imaging Inverse Problems: the Pros and Cons of Matrix Inversions ⋮ A new gradient method via least change secant update ⋮ A new conjugate gradient algorithm with cubic Barzilai–Borwein stepsize for unconstrained optimization ⋮ Unnamed Item ⋮ Proximal extrapolated gradient methods for variational inequalities ⋮ An efficient gradient method with approximate optimal stepsize for the strictly convex quadratic minimization problem ⋮ A NONMONOTONE FILTER BARZILAI-BORWEIN METHOD FOR OPTIMIZATION ⋮ IMPROVED PROJECTED GRADIENT ALGORITHMS FOR SINGLY LINEARLY CONSTRAINED QUADRATIC PROGRAMS SUBJECT TO LOWER AND UPPER BOUNDS ⋮ Accelerated method for optimization over density matrices in quantum state estimation ⋮ A hybrid reconstruction approach for absorption coefficient by fluorescence photoacoustic tomography ⋮ Unnamed Item ⋮ A derivative-free three-term projection algorithm involving spectral quotient for solving nonlinear monotone equations ⋮ A Modified PRP Conjugate Gradient Algorithm with Trust Region for Optimization Problems ⋮ Estimation of Graphical Models through Structured Norm Minimization ⋮ Nonmonotone Spectral Methods for Large-Scale Nonlinear Systems ⋮ An alternating direction method for linear‐constrained matrix nuclear norm minimization ⋮ Application of scaled nonlinear conjugate-gradient algorithms to the inverse natural convection problem ⋮ Unnamed Item ⋮ Coherence Retrieval Using Trace Regularization ⋮ Simple and Globally Convergent Methods for Accelerating the Convergence of Any EM Algorithm ⋮ Projected Barzilai–Borwein method for large-scale nonnegative image restoration ⋮ Projected gradient methods for synchrotron radiation spectra distribution function reconstruction ⋮ Unnamed Item ⋮ Search Direction Correction with Normalized Gradient Makes First-Order Methods Faster ⋮ Extension of the Barzilai–Borwein Method for Quadratic Forms in Finite Euclidean Spaces ⋮ Alternate step gradient method* ⋮ POSITIVELY CONSTRAINED TOTAL VARIATION PENALIZED IMAGE RESTORATION ⋮ On projected alternating BB methods for variational inequalities ⋮ A new steepest descent method with global convergence properties ⋮ On the Solution of ℓ₀-Constrained Sparse Inverse Covariance Estimation Problems ⋮ Unconstrained Optimization Techniques for the Acceleration of Alternating Projection Methods ⋮ Riemannian Optimization on the Symplectic Stiefel Manifold ⋮ An ADMM-based interior-point method for large-scale linear programming ⋮ A Perry-type derivative-free algorithm for solving nonlinear system of equations and minimizing ℓ₁regularized problem ⋮ NEW ADAPTIVE BARZILAI–BORWEIN STEP SIZE AND ITS APPLICATION IN SOLVING LARGE-SCALE OPTIMIZATION PROBLEMS ⋮ Convergence Rate Analysis of a Sequential Convex Programming Method with Line Search for a Class of Constrained Difference-of-Convex Optimization Problems ⋮ Equipping the Barzilai--Borwein Method with the Two Dimensional Quadratic Termination Property ⋮ Modified matrix-free methods for solving system of nonlinear equations ⋮ A modified two-point stepsize gradient algorithm for unconstrained minimization ⋮ Scaling techniques for gradient projection-type methods in astronomical image deblurring ⋮ An optimal tri-vector iterative algorithm for solving ill-posed linear inverse problems ⋮ Extended Dai-Yuan conjugate gradient strategy for large-scale unconstrained optimization with applications to compressive sensing ⋮ A CLASS OF MODIFIED BFGS METHODS WITH FUNCTION VALUE INFORMATION FOR UNCONSTRAINED OPTIMIZATION ⋮ Seismic impedance inversion using l ₁-norm regularization and gradient descent methods ⋮ First-Order Algorithms for a Class of Fractional Optimization Problems ⋮ Optimal control of viscous Burgers equation via an adaptive nonmonotone Barzilai–Borwein gradient method ⋮ A nonmonotone scaled conjugate gradient algorithm for large-scale unconstrained optimization ⋮ Combining line search and trust-region methods forℓ1-minimization ⋮ A Spectral Gradient Projection Method for the Positive Semi-definite Procrustes Problem ⋮ An adaptive nonmonotone global Barzilai–Borwein gradient method for unconstrained optimization ⋮ Filtered Gradient Algorithms for Inverse Design Problems of One-Dimensional Burgers Equation ⋮ Shearlet-based regularization in statistical inverse learning with an application to x-ray tomography ⋮ Gradient projection methods for quadratic programs and applications in training support vector machines ⋮ A New Augmented Lagrangian Method for MPCCs—Theoretical and Numerical Comparison with Existing Augmented Lagrangian Methods ⋮ Dualization and Automatic Distributed Parameter Selection of Total Generalized Variation via Bilevel Optimization ⋮ Delayed Gradient Methods for Symmetric and Positive Definite Linear Systems ⋮ Unnamed Item ⋮ CMFWI: Coupled Multiscenario Full Waveform Inversion ⋮ An adjoint method in inverse problems of chromatography ⋮ A new three-term spectral subgradient method for solving absolute value equation ⋮ Nonmonotone feasible arc search algorithm for minimization on Stiefel manifold ⋮ Inertial projected gradient method for large-scale topology optimization ⋮ New spectral LS conjugate gradient method for nonlinear unconstrained optimization ⋮ Nonmonotone quasi-Newton-based conjugate gradient methods with application to signal processing ⋮ Smooth over-parameterized solvers for non-smooth structured optimization ⋮ A gradient method exploiting the two dimensional quadratic termination property ⋮ A new multipoint symmetric secant method with a dense initial matrix ⋮ Convex regularization in statistical inverse learning problems ⋮ A Regularized Newton Method for \({\boldsymbol{\ell}}_{q}\) -Norm Composite Optimization Problems ⋮ Adaptive step size rules for stochastic optimization in large-scale learning ⋮ A penalty-free infeasible approach for a class of nonsmooth optimization problems over the Stiefel manifold ⋮ Solving graph equipartition SDPs on an algebraic variety ⋮ Linear convergence rate analysis of a class of exact first-order distributed methods for weight-balanced time-varying networks and uncoordinated step sizes ⋮ An acceleration of proximal diagonal Newton method ⋮ Alternating cyclic vector extrapolation technique for accelerating nonlinear optimization algorithms and fixed-point mapping applications ⋮ On the stationarity for nonlinear optimization problems with polyhedral constraints ⋮ A comparison of edge-preserving approaches for differential interference contrast microscopy ⋮ Sensitivity analysis and tailored design of minimization diagrams ⋮ Modified Dai-Zuan iterative scheme for nonlinear systems and its application ⋮ A hybrid BB-type method for solving large scale unconstrained optimization ⋮ A regularized limited memory subspace minimization conjugate gradient method for unconstrained optimization ⋮ Eigenvalue analyses on the memoryless Davidon-Fletcher-Powell method based on a spectral secant equation ⋮ Combined Newton-gradient method for constrained root-finding in chemical reaction networks ⋮ A NONMONOTONE ADMM-BASED DIAGONAL QUASI-NEWTON UPDATE WITH APPLICATION TO THE COMPRESSIVE SENSING PROBLEM ⋮ Spectral Properties of Barzilai--Borwein Rules in Solving Singly Linearly Constrained Optimization Problems Subject to Lower and Upper Bounds ⋮ Adjoint-based optimal control of contractile elastic bodies. Application to limbless locomotion on frictional substrates ⋮ A high order geometry conforming immersed finite element for elliptic interface problems ⋮ A modified Barzilai-Borwein algorithm for the generalized absolute value equation ⋮ A Barzilai-Borwein descent method for multiobjective optimization problems ⋮ A descent family of the spectral Hestenes–Stiefel method by considering the quasi-Newton method ⋮ An approximate Newton-type proximal method using symmetric rank-one updating formula for minimizing the nonsmooth composite functions ⋮ Proximal gradient/semismooth Newton methods for projection onto a polyhedron via the duality-gap-active-set strategy ⋮ On the Preconditioned Delayed Weighted Gradient Method ⋮ Computation of Sum of Squares Polynomials from Data Points ⋮ A partially inertial customized Douglas-Rachford splitting method for a class of structured optimization problems ⋮ A diagonally scaled Newton-type proximal method for minimization of the models with nonsmooth composite cost functions ⋮ Optimization on the symplectic Stiefel manifold: SR decomposition-based retraction and applications ⋮ Hybrid Algorithms for Finding a D-Stationary Point of a Class of Structured Nonsmooth DC Minimization ⋮ Weighted Trace-Penalty Minimization for Full Configuration Interaction ⋮ Hyperspectral super-resolution via low rank tensor triple decomposition ⋮ Analysis of a variable metric block coordinate method under proximal errors ⋮ Higher-Order Accurate Meshing of Implicitly Defined Tangential and Transversal Intersection Curves ⋮ An overview of nonlinear optimization ⋮ A convergence analysis of hybrid gradient projection algorithm for constrained nonlinear equations with applications in compressed sensing ⋮ Modified three-term derivative-free projection method for solving nonlinear monotone equations with application ⋮ Renewable Huber estimation method for streaming datasets ⋮ On the Derivation of Quasi-Newton Formulas for Optimization in Function Spaces ⋮ Convergence of Inexact Forward--Backward Algorithms Using the Forward--Backward Envelope ⋮ Real-time adaptive optics with pyramid wavefront sensors: part II. Accurate wavefront reconstruction using iterative methods ⋮ Gradient methods exploiting spectral properties ⋮ A New Diagonal Quasi-Newton Updating Method With Scaled Forward Finite Differences Directional Derivative for Unconstrained Optimization ⋮ Efficient Numerical Methods for Computing the Stationary States of Phase Field Crystal Models ⋮ Inexact primal–dual gradient projection methods for nonlinear optimization on convex set ⋮ CONVERGENCE PROPERTY AND MODIFICATIONS OF A MEMORY GRADIENT METHOD ⋮ Linearized Alternating Direction Method of Multipliers for Constrained Linear Least-Squares Problem ⋮ Jonathan Borwein: Renaissance Mathematician ⋮ IMRO: A Proximal Quasi-Newton Method for Solving $\ell_1$-Regularized Least Squares Problems ⋮ Smoothing projected cyclic Barzilai–Borwein method for stochastic linear complementarity problems ⋮ A projected derivative-free algorithm for nonlinear equations with convex constraints ⋮ Adaptive surface-related multiple subtraction using sparse norm minimization method ⋮ Gradient descent and fast artificial time integration ⋮ A Simulated Annealing-Based Barzilai–Borwein Gradient Method for Unconstrained Optimization Problems ⋮ Nonlinear conjugate gradient method for spectral tomosynthesis ⋮ Unnamed Item ⋮ Safe Triplet Screening for Distance Metric Learning ⋮ Spectral residual method without gradient information for solving large-scale nonlinear systems of equations ⋮ Sparse Recovery via Partial Regularization: Models, Theory, and Algorithms ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Derivative-free optimization methods ⋮ Parallelizable Algorithms for Optimization Problems with Orthogonality Constraints ⋮ On Quasi-Newton Forward-Backward Splitting: Proximal Calculus and Convergence ⋮ Blind Deconvolution by a Steepest Descent Algorithm on a Quotient Manifold ⋮ A Hybrid Finite-Dimensional RHC for Stabilization of Time-Varying Parabolic Equations ⋮ A spectral conjugate gradient method for nonlinear inverse problems ⋮ Sparse 3D reconstructions in electrical impedance tomography using real data ⋮ An adaptive nonmonotone trust region method based on a modified scalar approximation of the Hessian in the successive quadratic subproblems ⋮ Nonmonotone Enhanced Proximal DC Algorithms for a Class of Structured Nonsmooth DC Programming ⋮ High-Index Optimization-Based Shrinking Dimer Method for Finding High-Index Saddle Points ⋮ Unnamed Item ⋮ A time continuation based fast approximate algorithm for compressed sensing related optimization ⋮ A Proximal Gradient Method for Ensemble Density Functional Theory ⋮ An Efficient Gauss--Newton Algorithm for Symmetric Low-Rank Product Matrix Approximations ⋮ An Accelerated Linearized Alternating Direction Method of Multipliers ⋮ Unnamed Item ⋮ Training GANs with centripetal acceleration ⋮ Gravity-magnetic cross-gradient joint inversion by the cyclic gradient method ⋮ Multiscale Nonrigid Point Cloud Registration Using Rotation-Invariant Sliced-Wasserstein Distance via Laplace--Beltrami Eigenmap ⋮ A new spectral conjugate gradient method for large-scale unconstrained optimization ⋮ A regularized interior-point method for constrained linear least squares ⋮ Hierarchies of critical points of a Landau-de Gennes free energy on three-dimensional cuboids ⋮ An augmented Lagrangian method for optimization problems with structured geometric constraints ⋮ Computing the Action Ground State for the Rotating Nonlinear Schrödinger Equation ⋮ Global stabilizability to trajectories for the Schlögl equation in a Sobolev norm ⋮ On an iteratively reweighted linesearch based algorithm for nonconvex composite optimization ⋮ Efficient Nonnegative Matrix Factorization Via Modified Monotone Barzilai-Borwein Method with Adaptive Step Sizes Strategy ⋮ A homogeneous Rayleigh quotient with applications in gradient methods ⋮ A tensor optimization algorithm for computing Lagrangians of hypergraphs ⋮ Spectral conjugate gradient methods for vector optimization problems ⋮ An Accelerated Three-Term Extension of a Descent Nonlinear Conjugate Gradient Method ⋮ Sparse feedback stabilization in high‐order linear systems ⋮ A new nonmonotone spectral projected gradient algorithm for box-constrained optimization problems in \(m \times n\) real matrix space with application in image clustering ⋮ A framework for convex-constrained monotone nonlinear equations and its special cases ⋮ A competitive optimization approach for data clustering and orthogonal non-negative matrix factorization ⋮ On Online Parameter Identification in Laser-Induced Thermotherapy ⋮ Some accelerated alternating proximal gradient algorithms for a class of nonconvex nonsmooth problems ⋮ An inexact quasi-Newton algorithm for large-scale \(\ell_1\) optimization with box constraints ⋮ Optimal polynomial feedback laws for finite horizon control problems ⋮ Proportional inverse Gaussian distribution: A new tool for analysing continuous proportional data ⋮ Structured adaptive spectral-based algorithms for nonlinear least squares problems with robotic arm modelling applications ⋮ A stochastic variance reduced gradient using Barzilai-Borwein techniques as second order information ⋮ Voxel‐based finite elements with hourglass control in fast Fourier transform‐based computational homogenization ⋮ Performance of acceleration techniques for staggered phase-field solutions ⋮ Estimation for finite mixture of mode regression models using skew-normal distribution ⋮ SVRG meets AdaGrad: painless variance reduction ⋮ A mini-batch proximal stochastic recursive gradient algorithm with diagonal Barzilai-Borwein stepsize ⋮ Remarks on finite and infinite time-horizon optimal control problems ⋮ A wavelet-enhanced adaptive hierarchical FFT-based approach for the efficient solution of microscale boundary value problems ⋮ Secant Acceleration of Sequential Residual Methods for Solving Large-Scale Nonlinear Systems of Equations ⋮ Semiparametric Regression Analysis of Panel Count Data: A Practical Review ⋮ Minimization algorithms based on supervisor and searcher cooperation ⋮ Low cost optimization techniques for solving the nonlinear seismic reflection tomography problem ⋮ On the nonmonotone line search ⋮ Accelerated gradient descent methods with line search ⋮ On the steepest descent algorithm for quadratic functions ⋮ An efficient adaptive scaling parameter for the spectral conjugate gradient method ⋮ Essentials of numerical nonsmooth optimization ⋮ Essentials of numerical nonsmooth optimization ⋮ An Orthogonalization-Free Parallelizable Framework for All-Electron Calculations in Density Functional Theory ⋮ Accelerated multiple step-size methods for solving unconstrained optimization problems ⋮ Robust inference for skewed data in health sciences