The geometry of monotone operator splitting methods

DOI10.1017/S0962492923000065zbMATH Open1546.65037MaRDI QIDQ6598417FDOQ6598417

Authors: Patrick L. Combettes 

Publication date: 5 September 2024

Published in: Acta Numerica (Search for Journal in Brave)

Recommendations

• Asynchronous block-iterative primal-dual decomposition methods for monotone inclusions
• Solving monotone inclusions via compositions of nonexpansive averaged operators
• Monotone operator theory and splitting methods
• A monotone+skew splitting model for composite monotone inclusions in duality
• Primal-dual splitting algorithm for solving inclusions with mixtures of composite, Lipschitzian, and parallel-sum type monotone operators

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25) Optimality conditions and duality in mathematical programming (90C46) Monotone operators and generalizations (47H05) Iterative procedures involving nonlinear operators (47J25) Variational inequalities (49J40) Numerical solutions to equations with nonlinear operators (65J15) Programming in abstract spaces (90C48)

Cites Work

• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• ADMM for the SDP relaxation of the QAP
• Projective splitting with forward steps only requires continuity
• Rare feature selection in high dimensions
• Primal-dual extragradient methods for nonlinear nonsmooth PDE-constrained optimization
• Distributed optimization and statistical learning via the alternating direction method of multipliers
• A dual algorithm for the solution of nonlinear variational problems via finite element approximation
• On the Numerical Solution of Heat Conduction Problems in Two and Three Space Variables
• Splitting Algorithms for the Sum of Two Nonlinear Operators
• Title not available (Why is that?)
• On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators
• Proximal methods for hierarchical sparse coding
• Title not available (Why is that?)
• A Technique for the Numerical Solution of Certain Integral Equations of the First Kind
• Prox-Method with Rate of Convergence O(1/t) for Variational Inequalities with Lipschitz Continuous Monotone Operators and Smooth Convex-Concave Saddle Point Problems
• Convex Analysis
• Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems
• Multiplier and gradient methods
• Applications of a Splitting Algorithm to Decomposition in Convex Programming and Variational Inequalities
• Title not available (Why is that?)
• Hard-constrained inconsistent signal feasibility problems
• Proximal splitting methods in signal processing
• Solving monotone inclusions via compositions of nonexpansive averaged operators
• Signal Recovery by Proximal Forward-Backward Splitting
• Finite-Dimensional Variational Inequalities and Complementarity Problems
• Conjugate duality in convex optimization
• Monotone (nonlinear) operators in Hilbert space
• A proximal-based deomposition method for compositions method for convex minimization problems
• Image denoising and decomposition with total variation minimization and oscillatory functions
• An algorithm for total variation minimization and applications
• A hybrid approximate extragradient-proximal point algorithm using the enlargement of a maximal monotone operator
• A first-order primal-dual algorithm for convex problems with applications to imaging
• Forcing strong convergence of proximal point iterations in a Hilbert space
• The multiplier method of Hestenes and Powell applied to convex programming
• Dual norms and image decomposition models
• Linear passive systems and maximal monotone mappings
• Title not available (Why is that?)
• Tensor completion and low-\(n\)-rank tensor recovery via convex optimization
• Title not available (Why is that?)
• Nonlinear Ill-posed Problems of Monotone Type
• An EM algorithm for wavelet-based image restoration
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Monotone Operators and the Proximal Point Algorithm
• Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming
• Title not available (Why is that?)
• Bregman Monotone Optimization Algorithms
• An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Quelques résultats de Višik sur les problèmes elliptiques non linéaires par les méthodes de Minty-Browder
• Proximité et dualité dans un espace hilbertien
• Convex programming in Hilbert space
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Nonlinear Differential Equations of Monotone Types in Banach Spaces
• Title not available (Why is that?)
• Dissipative systems analysis and control. Theory and applications
• Ergodic convergence to a zero of the sum of monotone operators in Hilbert space
• An example concerning fixed points
• Quelques propriétés des opérateurs angle-bornes et n-cycliquement monotones
• Produits infinis de resolvantes
• Une méthode itérative de résolution d'une inéquation variationnelle
• A strongly convergent iterative solution of \(0 \in U(x)\) for a maximal monotone operator U in Hilbert space
• An alternating projection that does not converge in norm
• The primal Douglas-Rachford splitting algorithm for a class of monotone mappings with application to the traffic equilibrium problem
• A splitting algorithm for dual monotone inclusions involving cocoercive operators
• Convergence analysis for a primal-dual monotone + skew splitting algorithm with applications to total variation minimization
• A family of projective splitting methods for the sum of two maximal monotone operators
• Dual variational inequalities
• On generalized Nash games and variational inequalities
• Convergence analysis of primal-dual algorithms for a saddle-point problem: from contraction perspective
• Title not available (Why is that?)
• A parallel splitting method for coupled monotone inclusions
• A monotone+skew splitting model for composite monotone inclusions in duality
• The Cutting-Plane Method for Solving Convex Programs
• Characterizing arbitrarily slow convergence in the method of alternating projections
• A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms
• Title not available (Why is that?)
• On the Convergence of the Proximal Point Algorithm for Convex Minimization
• Title not available (Why is that?)
• Iteration methods for convexly constrained ill-posed problems in hilbert space
• Title not available (Why is that?)
• Title not available (Why is that?)
• Iterative methods for fixed point problems in Hilbert spaces
• Title not available (Why is that?)
• Title not available (Why is that?)
• Primal-dual splitting algorithm for solving inclusions with mixtures of composite, Lipschitzian, and parallel-sum type monotone operators
• The split common null point problem
• Title not available (Why is that?)
• A Modified Forward-Backward Splitting Method for Maximal Monotone Mappings
• A Douglas--Rachford Type Primal-Dual Method for Solving Inclusions with Mixtures of Composite and Parallel-Sum Type Monotone Operators
• Title not available (Why is that?)
• Stability Conditions for Systems with Monotone and Slope-Restricted Nonlinearities
• The method of projections for finding the common point of convex sets
• Title not available (Why is that?)
• Title not available (Why is that?)
• A Weak-to-Strong Convergence Principle for Fejér-Monotone Methods in Hilbert Spaces
• ON A „MONOTONICITY” METHOD FOR THE SOLUTION OF NONLINEAR EQUATIONS IN BANACH SPACES
• Mean Value Methods in Iteration
• The Relaxation Method for Linear Inequalities
• The Relaxation Method for Linear Inequalities
• Title not available (Why is that?)
• Iterative construction of the resolvent of a sum of maximal monotone operators
• A class of monotone operator functions related to electrical network theory
• Partial differential equations in the 20th century
• Projection and proximal point methods: Convergence results and counterexamples.
• Nonlinear semigroups in Hilbert space
• Methodes itératives pour les équations et inéquations aux dérivées partielles non linéaires de type monotone. (Iteration methods for nonlinear equations and inequations with partial derivatives of monotone type)
• Quasi-Fejérian analysis of some optimization algorithms
• A UNIFIED FRAMEWORK FOR SOME INEXACT PROXIMAL POINT ALGORITHMS^*
• A class of randomized primal-dual algorithms for distributed optimization
• A Dual Approach to Linear Inverse Problems with Convex Constraints
• The Numerical Solution of Parabolic and Elliptic Differential Equations
• An Algorithm for Restricted Least Squares Regression
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Convergence Rates in Forward--Backward Splitting
• Dualization of Generalized Equations of Maximal Monotone Type
• A class of decomposition methods for convex optimization and monotone variational inclusions via the hybrid inexact proximal point framework
• Systems of Structured Monotone Inclusions: Duality, Algorithms, and Applications
• Variable metric forward-backward splitting with applications to monotone inclusions in duality
• Stochastic quasi-Fejér block-coordinate fixed point iterations with random sweeping
• Multi-Valued Monotone Nonlinear Mappings and Duality Mappings in Banach Spaces
• Title not available (Why is that?)
• Monotone Operator Methods for Nash Equilibria in Non-potential Games
• Variable metric quasi-Fejér monotonicity
• Removing multiplicative noise by Douglas-Rachford splitting methods
• Proximal minimization algorithm with \(D\)-functions
• Gradient-based algorithms with applications to signal-recovery problems
• Alternating proximal algorithms for weakly coupled convex minimization problems. Applications to dynamical games and PDE's
• Title not available (Why is that?)
• Title not available (Why is that?)
• On the regularization of the sum of two maximal monotone operators
• Further applications of a splitting algorithm to decomposition in variational inequalities and convex programming
• A note on the forward-Douglas-Rachford splitting for monotone inclusion and convex optimization
• On the monotonicity of the gradient of a convex function
• On the Numerical Integration of $\frac{\partial ^2 u}{\partial x^2 } + \frac{\partial ^2 u}{\partial y^2 } = \frac{\partial u}{\partial t}$ by Implicit Methods
• Title not available (Why is that?)
• On Fixed Points of Non-Expansive Piecewise Isometric Mappings
• Proximal Decomposition on the Graph of a Maximal Monotone Operator
• Title not available (Why is that?)
• Partial inverse of a monotone operator
• The asymptotic behavior of the composition of two resolvents
• A cyclic projection algorithm via duality
• A successive projection method
• Decomposition through formalization in a product space
• Newton's method for convex programming and Tschebyscheff approximation
• Dissipative Operators and Hyperbolic Systems of Partial Differential Equations
• Title not available (Why is that?)
• Rate of Convergence Analysis of Decomposition Methods Based on the Proximal Method of Multipliers for Convex Minimization
• Dykstra's alternating projection algorithm for two sets
• On weak convergence of the Douglas-Rachford method
• Modified Lagrangians in convex programming and their generalizations
• A Douglas-Rachford splitting method for solving equilibrium problems
• Convex analysis and monotone operator theory in Hilbert spaces
• Tikhonov-regularization of ill-posed linear operator equations on closed convex sets
• Optimal transport with proximal splitting
• Monotone networks
• General Projective Splitting Methods for Sums of Maximal Monotone Operators
• Applications of the method of partial inverses to convex programming: Decomposition
• Primal-dual decomposition by operator splitting and applications to image deblurring
• Title not available (Why is that?)
• Fifty years of maximal monotonicity
• Lectures on topics in finite element solution of elliptic problems. Notes by G. Vijayasundaram
• A generalized forward-backward splitting
• Title not available (Why is that?)
• Title not available (Why is that?)
• Entropic Proximal Mappings with Applications to Nonlinear Programming
• Title not available (Why is that?)
• A class of Fejér convergent algorithms, approximate resolvents and the hybrid proximal-extragradient method
• Nonlinear Proximal Point Algorithms Using Bregman Functions, with Applications to Convex Programming
• Title not available (Why is that?)
• Some methods of speeding up the convergence of iteration methods
• A three-operator splitting scheme and its optimization applications
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• An algorithm for splitting parallel sums of linearly composed monotone operators, with applications to signal recovery
• Bregman forward-backward operator splitting
• Forward-backward splitting with Bregman distances
• The resolvent average of monotone operators: dominant and recessive properties
• Variational Analysis in Sobolev and BV Spaces
• Duality and stability in extremum problems involving convex functions
• Dualization of signal recovery problems
• A note on segmenting Mann iterates
• The solvability of non-linear functional equations
• Title not available (Why is that?)
• NON-LINEAR MONOTONE OPERATORS IN BANACH SPACES
• An introduction to continuous optimization for imaging
• Composition duality and maximal monotonicity
• Proximity for sums of composite functions
• Title not available (Why is that?)
• Title not available (Why is that?)
• An iterative solution of a variational inequality for certain monotone operators in Hilbert space
• Proximity Maps for Convex Sets
• Zur Theorie der nichtlinearen Integralgleichungen, Integralgleichungssysteme und allgemeinen Funktionalgleichungen
• A projective splitting method for monotone inclusions: iteration-complexity and application to composite optimization
• Stadium norm and Douglas-Rachford splitting: a new approach to road design optimization
• A simplified view of first order methods for optimization
• Regularizers for structured sparsity
• A parallel proximal splitting method for disparity estimation from multicomponent images under illumination variation
• Distributed Generalized Nash Equilibrium Seeking in Aggregative Games on Time-Varying Networks
• Title not available (Why is that?)
• Modern regularization methods for inverse problems
• Convergence of the forward-backward algorithm: beyond the worst-case with the help of geometry
• Proximal primal-dual best approximation algorithm with memory
• Optimization for data analysis
• Parallel random block-coordinate forward-backward algorithm: a unified convergence analysis
• Generalized duality in variational analysis.
• The distance between convex sets with Minkowski sum structure: application to collision detection
• The split feasibility problem with multiple output sets in Hilbert spaces
• Smoothing algorithms for computing the projection onto a Minkowski sum of convex sets
• Convergence Rates for Projective Splitting
• Single-forward-step projective splitting: exploiting cocoercivity
• A random block-coordinate Douglas-Rachford splitting method with low computational complexity for binary logistic regression
• A primal Douglas-Rachford splitting method for the constrained minimization problem in compressive sensing
• Solving composite fixed point problems with block updates
• The Krasnosel'skiĭ-Mann Iterative Method
• Forward-backward-half forward dynamical systems for monotone inclusion problems with application to v-GNE
• Dynamical systems coupled with monotone set-valued operators: formalisms, applications, well-posedness, and stability
• Synthesis of recurrent neural dynamics for monotone inclusion with application to Bayesian inference
• Projective splitting with forward steps
• Uniqueness of DRS as the 2 operator resolvent-splitting and impossibility of 3 operator resolvent-splitting
• Maximal monotonicity and cyclic monotonicity arising in nonsmooth Lur'e dynamical systems
• SURVEY: SIXTY YEARS OF DOUGLAS–RACHFORD
• Multivariate Monotone Inclusions in Saddle Form
• Fixed Point Strategies in Data Science
• ADMM-type methods for generalized Nash equilibrium problems in Hilbert spaces
• Warped proximal iterations for monotone inclusions
• Douglas-Rachford splitting and ADMM for pathological convex optimization
• Projective splitting as a warped proximal algorithm
• Nonlinear forward-backward splitting with projection correction
• Learning maximally monotone operators for image recovery
• A class of incrementally scattering-passive nonlinear systems
• On the strong convergence of forward-backward splitting in reconstructing jointly sparse signals
• Title not available (Why is that?)
• The Douglas-Rachford algorithm converges only weakly
• Perspective maximum likelihood-type estimation via proximal decomposition
• Hypercomplex Tensor Completion via Convex Optimization
• Title not available (Why is that?)
• On optimal operation of communication nets
• Über Systeme von nichtlinearen Integralgleichungen.
• Title not available (Why is that?)
• A generalized forward-backward splitting operator: degenerate analysis and applications
• Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists
• Resolvent and proximal compositions
• Primal-dual splittings as fixed point iterations in the range of linear operators
• Origin and Evolution of the Secant Method in One Dimension
• A note regarding abstract operators and passive networks
• Convergence of an asynchronous block-coordinate forward-backward algorithm for convex composite optimization
• A variational inequality model for the construction of signals from inconsistent nonlinear equations
• Analysis and Numerical Solution of a Modular Convex Nash Equilibrium Problem
• Facial reduction for symmetry reduced semidefinite and doubly nonnegative programs
• Circuit analysis using monotone+skew splitting
• Multidomain optimal control of variational subpotential mixed evolution inclusions
• Generalizations of the proximal method of multipliers in convex optimization
• Graphical Nonlinear System Analysis
• Monotone one-port circuits
• A Nonlinear Alternating Direction Method
• A primal-dual splitting algorithm for composite monotone inclusions with minimal lifting
• Inpainting by Flexible Haar-Wavelet Shrinkage
• Self-dual Partial Differential Systems and Their Variational Principles
• The Supporting Hyperplane Method for Unimodal Programming
• Title not available (Why is that?)
• Alternating proximal algorithms for linearly constrained variational inequalities: application to domain decomposition for PDE's
• Title not available (Why is that?)
• Title not available (Why is that?)
• Smooth methods of multipliers for complementarity problems
• Convergence d'un schéma de minimisation alternée
• Composition duality principles for mixed variational inequalities
• Proximal methods for the latent group lasso penalty
• Nonlinear networks. IIa
• A projection method for least-squares solutions to overdetermined systems of linear inequalities
• A primal-dual partial inverse algorithm for constrained monotone inclusions: applications to stochastic programming and mean field games
• Title not available (Why is that?)
• A primal-dual method of partial inverses for composite inclusions
• A SPLITTING METHOD FOR COMPOSITE MAPPINGS
• Title not available (Why is that?)
• Compositions and convex combinations of averaged nonexpansive operators
• Degenerate Preconditioned Proximal Point Algorithms
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Asynchronous stochastic coordinate descent: parallelism and convergence properties
• A survey on operator splitting and decomposition of convex programs
• Partial regularization of the sum of two maximal monotone operators
• Complementarity and variational inequalities in electronics
• The method of steepest descent for non-linear minimization problems
• Signal synthesis in the presence of an inconsistent set of constraints
• Implicit Alternating Direction Methods
• Title not available (Why is that?)
• Convex variational formulation with smooth coupling for multicomponent signal decomposition and recovery
• On the Douglas-Rachford algorithm
• Asymmetric forward-backward-adjoint splitting for solving monotone inclusions involving three operators
• Asynchronous block-iterative primal-dual decomposition methods for monotone inclusions
• Splitting Methods in Communication, Imaging, Science, and Engineering
• Forward-Backward-Half Forward Algorithm for Solving Monotone Inclusions
• Solving coupled composite monotone inclusions by successive Fejér approximations of their Kuhn-Tucker set
• An LS-free splitting method for composite mappings
• Consistent learning by composite proximal thresholding
• Backward-forward algorithms for structured monotone inclusions in Hilbert spaces
• Proximal activation of smooth functions in splitting algorithms for convex image recovery
• An Extension of the Auxiliary Problem Principle to Nonsymmetric Auxiliary Operators
• Title not available (Why is that?)
• On the complexity of the projective splitting and Spingarn's methods for the sum of two maximal monotone operators
• Best approximation from the Kuhn-Tucker set of composite monotone inclusions
• Accelerating block-decomposition first-order methods for solving composite saddle-point and two-player Nash equilibrium problems
• A strongly convergent primal-dual method for nonoverlapping domain decomposition
• The iterative solution of the equation $y \in x + Tx$ for a monotone operator $T$ in Hilbert space
• Subdivisions from primal and dual cones and polytopes
• Solving monotone stochastic variational inequalities and complementarity problems by progressive hedging
• Monotone operator theory in convex optimization
• Feedback Systems Described by Monotone Operators
• Surpassing gradient descent provably: a cyclic incremental method with linear convergence rate
• Title not available (Why is that?)
• Deep neural network structures solving variational inequalities
• Preconditioning of a generalized forward-backward splitting and application to optimization on graphs
• Relatively smooth convex optimization by first-order methods, and applications
• A descent lemma beyond Lipschitz gradient continuity: first-order methods revisited and applications
• Convergence of a relaxed inertial proximal algorithm for maximally monotone operators
• Fixing and extending some recent results on the ADMM algorithm
• Finding the forward-Douglas-Rachford-forward method
• A simplified form of block-iterative operator splitting and an asynchronous algorithm resembling the multi-block alternating direction method of multipliers
• ADMM for monotone operators: convergence analysis and rates
• Model Consistency of Partly Smooth Regularizers
• Quasi-Nonexpansive Iterations on the Affine Hull of Orbits: From Mann's Mean Value Algorithm to Inertial Methods
• Proximal methods for stationary mean field games with local couplings
• Operator splitting performance estimation: tight contraction factors and optimal parameter selection
• A distributed flexible delay-tolerant proximal gradient algorithm
• A general cone decomposition theory based on efficiency
• Notes on the difference of two monotone operators
• On the complexity of a hybrid proximal extragradient projective method for solving monotone inclusion problems
• Application of the projected Landweber method to the estimation of the source time function in seismology
• Title not available (Why is that?)
• The closure of the numerical range contains the spectrum
• Title not available (Why is that?)
• A reduction method for variational inequalities
• Title not available (Why is that?)
• On the extension and the solution of nonlinear operator equations
• Proximal algorithms for multicomponent image recovery problems
• On sums and convex combinations of projectors onto convex sets
• Title not available (Why is that?)
• Title not available (Why is that?)
• Nonlinear networks. I
• Title not available (Why is that?)
• Title not available (Why is that?)
• Nonlinear networks. IIb
• Algorithms and convergence results of projection methods for inconsistent feasibility problems: a review
• Resolvent splitting for sums of monotone operators with minimal lifting
• A decomposition method for solving multicommodity network equilibria
• Title not available (Why is that?)
• Nonlinear Monotone Networks
• Sur la distribution des propriétés de voisinage des fonctions de variables reelles.
• Theorie der reellen Funktionen. Erster Band.
• Über die Lage der Nullstellen von Polynomen, die aus Minimumforderungen gewisser Arten entspringen.
• Sur les fonctions convexes et les inégalités entre les valeurs moyennes.
• Memoir on discontinuous functions.

Cited In (3)

• Frugal Splitting Operators: Representation, Minimal Lifting, and Convergence
• Proximity operators of perspective functions with nonlinear scaling
• Integral resolvent and proximal mixtures

This page was built for publication: The geometry of monotone operator splitting methods

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6598417)