The Variable Metric Forward-Backward Splitting Algorithm Under Mild Differentiability Assumptions
From MaRDI portal
Publication:5363380
Abstract: We study the variable metric forward-backward splitting algorithm for convex minimization problems without the standard assumption of the Lipschitz continuity of the gradient. In this setting, we prove that, by requiring only mild assumptions on the smooth part of the objective function and using several types of line search procedures for determining either the gradient descent stepsizes, or the relaxation parameters, one still obtains weak convergence of the iterates and convergence in the objective function values. Moreover, the convergence rate in the function values is obtained if slightly stronger differentiability assumptions are added. We also illustrate several applications including problems that involve Banach spaces and functions of divergence type.
Recommendations
- Convergence analysis of a variable metric forward-backward splitting algorithm with applications
- Variable metric forward-backward splitting with applications to monotone inclusions in duality
- scientific article; zbMATH DE number 1749789
- The forward-backward splitting methods for variational inequalities and minimization problems in Banach spaces
- New convergence results for the inexact variable metric forward-backward method
- Forward-backward resolvent splitting methods for general mixed variational inequalities
- A Variable Metric Extension of the Forward–Backward–Forward Algorithm for Monotone Operators
- Relaxed forward-backward splitting methods for solving variational inclusions and applications
- Variable Metric Forward-Backward Algorithm for Composite Minimization Problems
- A self-adaptive forward-backward-forward algorithm for solving split variational inequalities
Cites work
- scientific article; zbMATH DE number 5077050 (Why is no real title available?)
- scientific article; zbMATH DE number 3719745 (Why is no real title available?)
- scientific article; zbMATH DE number 3626044 (Why is no real title available?)
- scientific article; zbMATH DE number 1206370 (Why is no real title available?)
- scientific article; zbMATH DE number 5060482 (Why is no real title available?)
- scientific article; zbMATH DE number 3293978 (Why is no real title available?)
- A Class of Inexact Variable Metric Proximal Point Algorithms
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- A Modified Forward-Backward Splitting Method for Maximal Monotone Mappings
- A coordinate gradient descent method for nonsmooth separable minimization
- A forward–backward splitting algorithm for the minimization of non-smooth convex functionals in Banach space
- Alternating proximal regularized dictionary learning
- An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
- Composite self-concordant minimization
- Compositions and convex combinations of averaged nonexpansive operators
- Convergence Rates in Forward--Backward Splitting
- Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
- Convergence rate analysis of several splitting schemes
- Convex analysis and monotone operator theory in Hilbert spaces
- Convex programming in Hilbert space
- Full convergence of the steepest descent method with inexact line searches
- Modified Fejér sequences and applications
- New convergence results for the scaled gradient projection method
- On the Goldstein-Levitin-Polyak gradient projection method
- On the convergence of primal-dual hybrid gradient algorithms for total variation image restoration
- On the convergence of the forward-backward splitting method with linesearches
- On the convergence properties of the projected gradient method for convex optimization
- Projected gradient methods for linearly constrained problems
- Proximal Newton-type methods for minimizing composite functions
- Quasi-Fejérian analysis of some optimization algorithms
- Regularization methods in Banach spaces.
- Signal Recovery by Proximal Forward-Backward Splitting
- Splitting methods with variable metric for Kurdyka-Łojasiewicz functions and general convergence rates
- The Baillon-Haddad theorem revisited
- The Gradient Projection Method under Mild Differentiability Conditions
- Two-Metric Projection Methods for Constrained Optimization
- Variable metric forward-backward algorithm for minimizing the sum of a differentiable function and a convex function
- Variable metric forward-backward splitting with applications to monotone inclusions in duality
- Variable metric inexact line-search-based methods for nonsmooth optimization
- Variable metric quasi-Fejér monotonicity
- What is the Subdifferential of the Closed Convex Hull of a Function?
Cited in
(43)- Multi-step inertial forward-backward-half forward algorithm for solving monotone inclusion
- Global complexity analysis of inexact successive quadratic approximation methods for regularized optimization under mild assumptions
- Forward-backward algorithm for functions with locally Lipschitz gradient: applications to mean field games
- A novel stepsize for gradient descent method
- On the convergence of the forward-backward splitting method with linesearches
- An accelerated forward-backward-half forward splitting algorithm for monotone inclusion with applications to image restoration
- An interior proximal gradient method for nonconvex optimization
- Proximal Gradient Methods for Machine Learning and Imaging
- An inexact successive quadratic approximation method for a class of difference-of-convex optimization problems
- Variable metric forward-backward algorithm for minimizing the sum of a differentiable function and a convex function
- A Regularized Newton Method for \({\boldsymbol{\ell}}_{q}\) -Norm Composite Optimization Problems
- A Variable Metric Extension of the Forward–Backward–Forward Algorithm for Monotone Operators
- Variable metric techniques for forward-backward methods in imaging
- Parallel random block-coordinate forward-backward algorithm: a unified convergence analysis
- Splitting methods with variable metric for Kurdyka-Łojasiewicz functions and general convergence rates
- Variable Metric Forward-Backward Algorithm for Composite Minimization Problems
- A proximal interior point algorithm with applications to image processing
- Convergence of the forward-backward algorithm: beyond the worst-case with the help of geometry
- The forward-backward splitting method for finding the minimum like-norm solution of the mixed variational inequality problem
- Proximal gradient algorithms under local Lipschitz gradient continuity. A convergence and robustness analysis of PANOC
- A block coordinate variable metric linesearch based proximal gradient method
- Convergence Analysis for Bregman Iterations in Minimizing a Class of Landau Free Energy Functionals
- On the linear convergence of forward-backward splitting method. I: Convergence analysis
- Quadratic growth conditions and uniqueness of optimal solution to Lasso
- A VMiPG method for composite optimization with nonsmooth term having no closed-form proximal mapping
- Novel algorithms based on forward-backward splitting technique: effective methods for regression and classification
- Modified Fejér sequences and applications
- On the finite termination of the gradient projection method
- Generalized support vector regression: duality and tensor-kernel representation
- Forward-Backward-Half Forward Algorithm for Solving Monotone Inclusions
- The forward-backward splitting method for non-Lipschitz continuous minimization problems in Banach spaces
- An inexact gradient mirror descent algorithm for non-smooth convex optimization
- Metric selection in fast dual forward-backward splitting
- Proximal extrapolated gradient methods for variational inequalities
- Four-operator splitting via a forward-backward-half-forward algorithm with line search
- Parallel Normal S-Iteration Methods with Applications to Optimization Problems
- Forward-backward penalty scheme for constrained convex minimization without inf-compactness
- Convergence analysis of a variable metric forward-backward splitting algorithm with applications
- New convergence results for the inexact variable metric forward-backward method
- A new proximal heavy ball inexact line-search algorithm
- Convergence of the exponentiated gradient method with Armijo line search
- The developments of proximal point algorithms
- Bregman forward-backward operator splitting
This page was built for publication: The Variable Metric Forward-Backward Splitting Algorithm Under Mild Differentiability Assumptions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5363380)