A proximal subgradient algorithm with extrapolation for structured nonconvex nonsmooth problems
In the paper under review, the authors study a following broad optimization problem which has many important applications in diverse areas, including power control problems, compressed sensing, portfolio optimization, supply chain problems, image segmentation and many others. The objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous gradient, subtracted by a weakly convex function. This general framework allows for problems involving nonconvex loss functions and problems with specific nonconvex constraints. The problem is: \(\min_{x\in C} F(x)\) where \(F(x) := f (x) + h(Ax)-g(x)\) and where \(C\) is a nonempty closed subset of a finite-dimensional real Hilbert space \(H\), \(A\) is a linear mapping from \(H\) to another finite-dimensional real Hilbert space, \(f : H\to (-\infty,\infty]\) is a proper lower semicontinuous (possibly nonsmooth and nonconvex) function, \(h\) is a real valued differentiable (possibly nonconvex) function whose gradient is Lipschitz continuous and \(g:H\to (-\infty,\infty]\) is a continuous weakly convex function with modulus on an open convex set containing \(C\). Two examples are: (1) From statistical learning, \(\min_{x\in \mathbb R^d}(\phi(x) + \gamma r(x))\) where \(\phi\) is called a loss function which measures the data fitting, \(r\) is a regularization which promotes specific structure in the solution such as sparsity, and \(\gamma>0\) is a weighting parameter. (2) \(\min_{x\in \mathbb R^d} (f (x) + h(x)- g(x))\). The paper is well written with a good set of references.
- An inexact proximal gradient algorithm with extrapolation for a class of nonconvex nonsmooth optimization problems
- Difference-of-convex algorithm with extrapolation for nonconvex, nonsmooth optimization problems
- Some accelerated alternating proximal gradient algorithms for a class of nonconvex nonsmooth problems
- An extrapolated proximal iteratively reweighted method for nonconvex composite optimization problems
- Extrapolated smoothing descent algorithm for constrained nonconvex and nonsmooth composite problems
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- A Lyapunov-type approach to convergence of the Douglas-Rachford algorithm for a nonconvex setting
- A proximal difference-of-convex algorithm with extrapolation
- An inexact successive quadratic approximation method for a class of difference-of-convex optimization problems
- Analysis of the Recovery of Edges in Images and Signals by Minimizing Nonconvex Regularized Least-Squares
- Calculus of the exponent of Kurdyka-Łojasiewicz inequality and its applications to linear convergence of first-order methods
- Clarke Subgradients of Stratifiable Functions
- Convergence analysis of a proximal point algorithm for minimizing differences of functions
- Convergence rates of inertial forward-backward algorithms
- Convex Relaxation of Optimal Power Flow—Part I: Formulations and Equivalence
- DC formulations and algorithms for sparse optimization problems
- DC programming and DCA: thirty years of developments
- Difference-of-convex learning: directional stationarity, optimality, and sparsity
- Enhanced proximal DC algorithms with extrapolation for a class of structured nonsmooth DC minimization
- Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs
- Fast L1-L2 minimization via a proximal operator
- First-order methods in optimization
- Global convergence of a proximal linearized algorithm for difference of convex functions
- Inertial Proximal Block Coordinate Method for a Class of Nonsmooth Sum-of-Ratios Optimization Problems
- Inexact accelerated high-order proximal-point methods
- Joint Optimization of Source Power Allocation and Distributed Relay Beamforming in Multiuser Peer-to-Peer Relay Networks
- Lectures on convex optimization
- Nearly unbiased variable selection under minimax concave penalty
- Nonmonotone enhanced proximal DC algorithms for a class of structured nonsmooth DC programming
- On gradients of functions definable in o-minimal structures
- On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
- Proximal operator and optimality conditions for ramp loss SVM
- Some methods of speeding up the convergence of iteration methods
- Variational Analysis
- Wavelets in statistics: A review
- A proximal difference-of-convex algorithm with extrapolation
- scientific article; zbMATH DE number 6719195 (Why is no real title available?)
- A Proximal Minimization Algorithm for Structured Nonconvex and Nonsmooth Problems
- Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs
- An extrapolated proximal iteratively reweighted method for nonconvex composite optimization problems
- An approximation proximal gradient algorithm for nonconvex-linear minimax problems with nonconvex nonsmooth terms
- Difference-of-convex algorithm with extrapolation for nonconvex, nonsmooth optimization problems
- Bregman proximal linearized ADMM for minimizing separable sums coupled by a difference of functions
- The boosted double-proximal subgradient algorithm for nonconvex optimization
- Optimality analysis on ℓ 0/1 -sparsity regularized nonsmooth optimization
- A proximal splitting algorithm for generalized DC programming with applications in signal recovery
- Doubly relaxed forward-Douglas-Rachford splitting for the sum of two nonconvex and a DC function
This page was built for publication: A proximal subgradient algorithm with extrapolation for structured nonconvex nonsmooth problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6141533)