A proximal subgradient algorithm with extrapolation for structured nonconvex nonsmooth problems
From MaRDI portal
Publication:6141533
Abstract: In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function whose gradient is Lipschitz continuous, subtracted by a weakly convex function. This type of structured problems has many practical applications in machine learning and statistics such as compressed sensing, signal recovery, sparse dictionary learning, clustering, matrix factorization, and others. We develop a flexible extrapolated proximal subgradient algorithm for solving these problems with guaranteed subsequential convergence to a stationary point. The global convergence of the whole sequence generated by our algorithm is also established under the Kurdyka-Lojasiewicz property. To illustrate the promising numerical performance of the proposed algorithm, we conduct numerical experiments on two important nonconvex models. This includes a least squares problem with a nonconvex regularization and an optimal power flow problem with distributed energy resources.
Recommendations
- An inexact proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth optimization problems
- Difference-of-convex algorithm with extrapolation for nonconvex, nonsmooth optimization problems
- Some accelerated alternating proximal gradient algorithms for a class of nonconvex nonsmooth problems
- An extrapolated proximal iteratively reweighted method for nonconvex composite optimization problems
- Extrapolated smoothing descent algorithm for constrained nonconvex and nonsmooth composite problems
Cites work
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- A Lyapunov-type approach to convergence of the Douglas-Rachford algorithm for a nonconvex setting
- A proximal difference-of-convex algorithm with extrapolation
- An inexact successive quadratic approximation method for a class of difference-of-convex optimization problems
- Analysis of the Recovery of Edges in Images and Signals by Minimizing Nonconvex Regularized Least-Squares
- Calculus of the exponent of Kurdyka-Łojasiewicz inequality and its applications to linear convergence of first-order methods
- Clarke Subgradients of Stratifiable Functions
- Convergence analysis of a proximal point algorithm for minimizing differences of functions
- Convergence rates of inertial forward-backward algorithms
- Convex Relaxation of Optimal Power Flow—Part I: Formulations and Equivalence
- DC formulations and algorithms for sparse optimization problems
- DC programming and DCA: thirty years of developments
- Difference-of-convex learning: directional stationarity, optimality, and sparsity
- Enhanced proximal DC algorithms with extrapolation for a class of structured nonsmooth DC minimization
- Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs
- Fast L1-L2 minimization via a proximal operator
- First-order methods in optimization
- Global convergence of a proximal linearized algorithm for difference of convex functions
- Inertial Proximal Block Coordinate Method for a Class of Nonsmooth Sum-of-Ratios Optimization Problems
- Inexact accelerated high-order proximal-point methods
- Joint Optimization of Source Power Allocation and Distributed Relay Beamforming in Multiuser Peer-to-Peer Relay Networks
- Lectures on convex optimization
- Nearly unbiased variable selection under minimax concave penalty
- Nonmonotone enhanced proximal DC algorithms for a class of structured nonsmooth DC programming
- On gradients of functions definable in o-minimal structures
- On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
- Proximal operator and optimality conditions for ramp loss SVM
- Some methods of speeding up the convergence of iteration methods
- Variational Analysis
- Wavelets in statistics: A review
Cited in
(8)- A Proximal Minimization Algorithm for Structured Nonconvex and Nonsmooth Problems
- A proximal difference-of-convex algorithm with extrapolation
- Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs
- An extrapolated proximal iteratively reweighted method for nonconvex composite optimization problems
- An approximation proximal gradient algorithm for nonconvex-linear minimax problems with nonconvex nonsmooth terms
- Difference-of-convex algorithm with extrapolation for nonconvex, nonsmooth optimization problems
- Bregman proximal linearized ADMM for minimizing separable sums coupled by a difference of functions
- scientific article; zbMATH DE number 6719195 (Why is no real title available?)
This page was built for publication: A proximal subgradient algorithm with extrapolation for structured nonconvex nonsmooth problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6141533)
