Accelerated inexact composite gradient methods for nonconvex spectral optimization problems
From MaRDI portal
Abstract: This paper presents two inexact composite gradient methods, one inner accelerated and another doubly accelerated, for solving a class of nonconvex spectral composite optimization problems. More specifically, the objective function for these problems is of the form where and are differentiable nonconvex matrix functions with Lipschitz continuous gradients, is a proper closed convex matrix function, and both and can be expressed as functions that operate on the singular values of their inputs. The methods essentially use an accelerated composite gradient method to solve a sequence of proximal subproblems involving the linear approximation of and the singular value functions underlying and . Unlike other composite gradient-based methods, the proposed methods take advantage of both the composite and spectral structure underlying the objective function in order to efficiently generate their solutions. Numerical experiments are presented to demonstrate the practicality of these methods on a set of real-world and randomly generated spectral optimization problems.
Recommendations
- Accelerated methods for nonconvex optimization
- An accelerated coordinate gradient descent algorithm for non-separable composite optimization
- Accelerated gradient methods for nonconvex nonlinear and stochastic programming
- A note on the (accelerated) proximal gradient method for composite convex optimization
- Accelerated randomized mirror descent algorithms for composite non-strongly convex optimization
- An Accelerated Composite Gradient Method for Large-Scale Composite Objective Problems
- Nonsmooth spectral gradient methods for unconstrained optimization
- An improved spectral conjugate gradient algorithm for nonconvex unconstrained optimization problems
- An efficient adaptive accelerated inexact proximal point method for solving linearly constrained nonconvex composite problems
- An average curvature accelerated composite gradient method for nonconvex smooth composite optimization problems
Cites work
- scientific article; zbMATH DE number 823379 (Why is no real title available?)
- A FISTA-type accelerated gradient algorithm for solving smooth nonconvex composite optimization problems
- A proximal difference-of-convex algorithm with extrapolation
- Accelerated gradient methods for nonconvex nonlinear and stochastic programming
- Accelerated methods for nonconvex optimization
- An accelerated HPE-type algorithm for a class of composite convex-concave saddle-point problems
- An adaptive accelerated first-order method for convex optimization
- An efficient adaptive accelerated inexact proximal point method for solving linearly constrained nonconvex composite problems
- Complexity of a quadratic penalty accelerated inexact proximal point method for solving linearly constrained nonconvex composite programs
- Difference-of-convex learning: directional stationarity, optimality, and sparsity
- Efficiency of minimizing compositions of convex functions and smooth maps
- Efficient learning with a family of nonconvex regularizers by redistributing nonconvexity
- First-order methods in optimization
- Generalized uniformly optimal methods for nonlinear programming
- Gradient methods for minimizing composite functions
- Phase retrieval via matrix completion
Cited in
(3)
This page was built for publication: Accelerated inexact composite gradient methods for nonconvex spectral optimization problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2149955)