A generalized forward-backward splitting

DOI10.1137/120872802MaRDI QIDQ2873234zbMATH OpenOpenAlexFDO

Authors Hugo Raguet, Jalal Fadili, Gabriel Peyré

Publication date 23 January 2014

Published in SIAM Journal on Imaging Sciences (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1108.4404

zbMATH Keywords

forward-backward algorithmimage processingmonotone operator splittingnonsmooth convex optimizationproximal splittingsparsity

Mathematics Subject Classification ID

Applications of operator theory in optimization, convex analysis, mathematical programming, economics (47N10) Convex programming (90C25) Image processing (compression, reconstruction, etc.) in information and communication theory (94A08)

Abstract: This paper introduces the generalized forward-backward splitting algorithm for minimizing convex functions of the form $F+su{m}_{i=1}^n{G}_i$, where $F$ has a Lipschitz-continuous gradient and the $G_i$'s are simple in the sense that their Moreau proximity operators are easy to compute. While the forward-backward algorithm cannot deal with more than $n=1$ non-smooth function, our method generalizes it to the case of arbitrary $n$. Our method makes an explicit use of the regularity of $F$ in the forward step, and the proximity operators of the $G_i$'s are applied in parallel in the backward step. This allows the generalized forward backward to efficiently address an important class of convex problems. We prove its convergence in infinite dimension, and its robustness to errors on the computation of the proximity operators and of the gradient of $F$. Examples on inverse problems in imaging demonstrate the advantage of the proposed methods in comparison to other splitting algorithms.

Recommendations

• Preconditioning of a generalized forward-backward splitting and application to optimization on graphs
• Convergence of the forward-backward method for split null-point problems beyond cocoerciveness
• The generalized forward-backward splitting method for the minimization of the sum of two functions in Banach spaces
• A forward–backward splitting algorithm for the minimization of non-smooth convex functionals in Banach space
• An inertial forward-backward algorithm for monotone inclusions

Cited in

(only showing first 100 items - show all)

• Tseng type methods for solving inclusion problems and its applications
• Monotone operator theory in convex optimization
• Supervised nonnegative matrix factorization via minimization of regularized Moreau-envelope of divergence function with application to music transcription
• The Shannon total variation
• A global sparse gradient based coupled system for image denoising
• Local and global convergence of a general inertial proximal splitting scheme for minimizing composite functions
• Modified forward-backward splitting method for variational inclusions
• Preconditioned Douglas-Rachford type primal-dual method for solving composite monotone inclusion problems with applications
• A strongly convergent algorithm for solving common variational inclusion with application to image recovery problems
• Four-operator splitting via a forward-backward-half-forward algorithm with line search
• An inertial semi-forward-reflected-backward splitting and its application
• Convergence analysis and applications of the inertial algorithm solving inclusion problems
• Modified Tseng's splitting algorithms for the sum of two monotone operators in Banach spaces
• An adaptive splitting algorithm for the sum of two generalized monotone operators and one cocoercive operator
• Inertial iterative method with self-adaptive step size for finite family of split monotone variational inclusion and fixed point problems in Banach spaces
• A product space reformulation with reduced dimension for splitting algorithms
• A parallel Tseng's splitting method for solving common variational inclusion applied to signal recovery problems
• Iterative method with inertial terms for nonexpansive mappings: applications to compressed sensing
• Backward-forward-reflected-backward splitting for three operator monotone inclusions
• Three new iterative methods for solving inclusion problems and related problems
• Alternating forward-backward splitting for linearly constrained optimization problems
• Uniqueness of DRS as the 2 operator resolvent-splitting and impossibility of 3 operator resolvent-splitting
• Three-operator splitting algorithm for a class of variational inclusion problems
• A proximal interior point algorithm with applications to image processing
• Local behavior of sparse analysis regularization: applications to risk estimation
• Projective splitting methods for sums of maximal monotone operators with applications
• Finding the forward-Douglas-Rachford-forward method
• A note on the forward-Douglas-Rachford splitting for monotone inclusion and convex optimization
• Convergence rates of forward-Douglas-Rachford splitting method
• An inertial parallel and asynchronous forward-backward iteration for distributed convex optimization
• Strong convergence of a forward-backward splitting method with a new step size for solving monotone inclusions
• Designing Gabor windows using convex optimization
• Convergence analysis of an inexact three-operator splitting algorithm
• Convergence of a relaxed inertial forward-backward algorithm for structured monotone inclusions
• A splitting algorithm for coupled system of primal-dual monotone inclusions
• Local convergence properties of Douglas-Rachford and alternating direction method of multipliers
• MiKM: multi-step inertial Krasnosel'skiǐ-Mann algorithm and its applications
• Generalized forward-backward splitting with penalization for monotone inclusion problems
• Preconditioned three-operator splitting algorithm with applications to image restoration
• Cocoercivity, smoothness and bias in variance-reduced stochastic gradient methods
• Forward-partial inverse-half-forward splitting algorithm for solving monotone inclusions
• A new modified forward-backward-forward algorithm for solving inclusion problems
• A generalized forward-backward splitting operator: degenerate analysis and applications
• A novel algorithm for approximating common solution of a system of monotone inclusion problems and common fixed point problem
• Preconditioning of a generalized forward-backward splitting and application to optimization on graphs
• Low complexity regularization of linear inverse problems
• A stochastic inertial forward–backward splitting algorithm for multivariate monotone inclusions
• Convergence rate analysis of the forward-Douglas-Rachford splitting scheme
• Convergence rates with inexact non-expansive operators
• Activity identification and local linear convergence of Douglas-Rachford/ADMM under partial smoothness
• Manifold-valued data in medical imaging applications
• A sequential constraint method for solving variational inequality over the intersection of fixed point sets
• Dynamical systems and forward-backward algorithms associated with the sum of a convex subdifferential and a monotone cocoercive operator
• A convex approach for image restoration with exact Poisson-Gaussian likelihood
• A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms
• A generalized state-splitting algorithm
• String-averaging incremental stochastic subgradient algorithms
• Stability of quasi-simple heteroclinic cycles
• Cut pursuit: fast algorithms to learn piecewise constant functions on general weighted graphs
• Blind source separation with outliers in transformed domains
• Stable optimizationless recovery from phaseless linear measurements
• Compositions and convex combinations of averaged nonexpansive operators
• Forward-partial inverse-forward splitting for solving monotone inclusions
• Operator-valued kernel-based vector autoregressive models for network inference
• Generalized conditional gradient with augmented Lagrangian for composite minimization
• On the linear convergence rate of a relaxed forward–backward splitting method
• Fast convergence of generalized forward-backward algorithms for structured monotone inclusions
• Stable image reconstruction using transformed total variation minimization
• Operator splitting performance estimation: tight contraction factors and optimal parameter selection
• A modified greedy analysis pursuit algorithm for the cosparse analysis model
• Convergence of the forward-backward method for split null-point problems beyond cocoerciveness
• A Scale-Invariant Approach for Sparse Signal Recovery
• A dynamical system associated with the fixed points set of a nonexpansive operator
• On quasi-Newton forward-backward splitting: proximal calculus and convergence
• A proximal point method for the sum of maximal monotone operators
• Inertial methods for fixed point problems and zero point problems of the sum of two monotone mappings
• Stochastic quasi-Fejér block-coordinate fixed point iterations with random sweeping
• An introduction to continuous optimization for imaging
• Splitting proximal with penalization schemes for additive convex hierarchical minimization problems
• A stochastic variance reduced primal dual fixed point method for linearly constrained separable optimization
• Compressive imaging through optical fiber with partial speckle scanning
• Degenerate Preconditioned Proximal Point Algorithms
• Bayesian computation: a summary of the current state, and samples backwards and forwards
• Mann-type algorithms for solving the monotone inclusion problem and the fixed point problem in reflexive Banach spaces
• An inertial viscosity algorithm for solving monotone variational inclusion and common fixed point problems of strict pseudocontractions
• Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists
• Nonlinear forward-backward splitting with momentum correction
• Forward-backward-forward algorithms involving two inertial terms for monotone inclusions
• A modified Tseng splitting method with double inertial steps for solving monotone inclusion problems
• A new projection algorithm for variational inclusion problems and its application to cervical cancer disease prediction
• Distributed forward-backward methods for ring networks
• Solving monotone inclusions involving the sum of three maximally monotone operators and a cocoercive operator with applications
• Multi-step inertial forward-backward-half forward algorithm for solving monotone inclusion
• A three-operator splitting algorithm with deviations for generalized DC programming
• On and Beyond Total Variation Regularization in Imaging: The Role of Space Variance
• An accelerated forward-backward-half forward splitting algorithm for monotone inclusion with applications to image restoration
• Accelerated forward–backward algorithms for structured monotone inclusions
• The game model with multi-task for image denoising and edge extraction
• Proximal-based recursive implementation for model-free data-driven fault diagnosis
• Variational model-based reconstruction techniques for multi-patch data in magnetic particle imaging

This page was built for publication: A generalized forward-backward splitting

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2873234)