A survey on some recent developments of alternating direction method of multipliers

DOI10.1007/S40305-021-00368-3zbMath1499.90158OpenAlexW4205808776MaRDI QIDQ2136506

Deren Han

Publication date: 10 May 2022

Published in: Journal of the Operations Research Society of China (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s40305-021-00368-3

zbMATH Keywords

rate of convergenceglobal convergencenonconvex optimizationalternating direction method of multipliers

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25) Nonconvex programming, global optimization (90C26) Nonlinear programming (90C30) Complementarity and equilibrium problems and variational inequalities (finite dimensions) (aspects of mathematical programming) (90C33)

Related Items (26)

A new hybrid regularization scheme for removing salt and pepper noise ⋮ Sparse broadband beamformer design via proximal optimization Techniques ⋮ An efficient semi-proximal ADMM algorithm for low-rank and sparse regularized matrix minimization problems with real-world applications ⋮ Randomized Douglas–Rachford Methods for Linear Systems: Improved Accuracy and Efficiency ⋮ A new stopping criterion for Eckstein and Bertsekas's generalized alternating direction method of multipliers ⋮ Understanding the convergence of the preconditioned PDHG method: a view of indefinite proximal ADMM ⋮ A partially inertial customized Douglas-Rachford splitting method for a class of structured optimization problems ⋮ Inexact generalized ADMM with relative error criteria for linearly constrained convex optimization problems ⋮ Convergence analysis of an ALF-based nonconvex splitting algorithm with SQP structure ⋮ Alternating direction method of multipliers for nonconvex log total variation image restoration ⋮ The exact worst-case convergence rate of the alternating direction method of multipliers ⋮ Convergence analysis on the alternating direction method of multipliers for the cosparse optimization problem ⋮ Stochastic Gauss-Seidel type inertial proximal alternating linearized minimization and its application to proximal neural networks ⋮ A Bregman-style improved ADMM and its linearized version in the nonconvex setting: convergence and rate analyses ⋮ Customized Douglas-Rachford splitting methods for structured inverse variational inequality problems ⋮ Extrapolated plug-and-play three-operator splitting methods for nonconvex optimization with applications to image restoration ⋮ A partial Bregman ADMM with a general relaxation factor for structured nonconvex and nonsmooth optimization ⋮ Nonconvex multi-period mean-variance portfolio optimization ⋮ A customized inertial proximal alternating minimization for SVD-free robust principal component analysis ⋮ An inertial proximal splitting method with applications ⋮ Stochastic linearized generalized alternating direction method of multipliers: expected convergence rates and large deviation properties ⋮ An inexact majorized proximal alternating direction method of multipliers for diffusion tensors ⋮ Two linear proximal Peaceman-Rachford splitting algorithms for nonconvex and nonsmooth nonseparable optimization ⋮ An inertial proximal partially symmetric ADMM-based algorithm for linearly constrained multi-block nonconvex optimization problems with applications ⋮ An inexact symmetric ADMM algorithm with indefinite proximal term for sparse signal recovery and image restoration problems ⋮ Inertial accelerated SGD algorithms for solving large-scale lower-rank tensor CP decomposition problems

Uses Software

• BADMM
• RASL

Cites Work

• Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers
• Nearly unbiased variable selection under minimax concave penalty
• Nonlinear total variation based noise removal algorithms
• Latent variable graphical model selection via convex optimization
• Douglas-Rachford splitting for nonconvex optimization with application to nonconvex feasibility problems
• A practical relative error criterion for augmented Lagrangians
• A parallel splitting method for separable convex programs
• Proximal alternating linearized minimization for nonconvex and nonsmooth problems
• Variable metric forward-backward algorithm for minimizing the sum of a differentiable function and a convex function
• On the linear convergence of the alternating direction method of multipliers
• A class of linearized proximal alternating direction methods
• An approximate proximal-extragradient type method for monotone variational inequalities
• Parallel splitting augmented Lagrangian methods for monotone structured variational inequalities
• On the sublinear convergence rate of multi-block ADMM
• On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
• Convergence to equilibrium for the backward Euler scheme and applications
• On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators
• A dual algorithm for the solution of nonlinear variational problems via finite element approximation
• On gradients of functions definable in o-minimal structures
• A variable-penalty alternating directions method for convex optimization
• Some convergence properties of a method of multipliers for linearly constrained monotone variational inequalities
• Error bounds and convergence analysis of feasible descent methods: A general approach
• A proximal-based deomposition method for compositions method for convex minimization problems
• Introductory lectures on convex optimization. A basic course.
• A new hybrid generalized proximal point algorithm for variational inequality problems
• A hybrid approximate extragradient-proximal point algorithm using the enlargement of a maximal monotone operator
• Alternating direction method with self-adaptive penalty parameters for monotone variational inequalities
• A new inexact alternating directions method for monotone variational inequalities
• A note on the Douglas-Rachford splitting method for optimization problems involving hypoconvex functions
• Relative-error approximate versions of Douglas-Rachford splitting and special cases of the ADMM
• On the information-adaptive variants of the ADMM: an iteration complexity perspective
• Approximate ADMM algorithms derived from Lagrangian splitting
• Convergence of ADMM for multi-block nonconvex separable optimization models
• Parallel multi-block ADMM with \(o(1/k)\) convergence
• Structured nonconvex and nonsmooth optimization: algorithms and iteration complexity analysis
• Global convergence of ADMM in nonconvex nonsmooth optimization
• On inexact ADMMs with relative error criteria
• A note on the alternating direction method of multipliers
• Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
• An ADM-based splitting method for separable convex programming
• On the convergence analysis of the alternating direction method of multipliers with three blocks
• Local linear convergence of the alternating direction method of multipliers for nonconvex separable optimization problems
• Convergence of non-smooth descent methods using the Kurdyka-Łojasiewicz inequality
• Splitting methods with variable metric for Kurdyka-Łojasiewicz functions and general convergence rates
• On non-ergodic convergence rate of Douglas-Rachford alternating direction method of multipliers
• A partial splitting augmented Lagrangian method for low patch-rank image decomposition
• On the convergence of the direct extension of ADMM for three-block separable convex minimization models with one strongly convex function
• On the global and linear convergence of the generalized alternating direction method of multipliers
• \(O(1/t)\) complexity analysis of the generalized alternating direction method of multipliers
• A new partial splitting augmented Lagrangian method for minimizing the sum of three convex functions
• A customized Douglas-Rachford splitting algorithm for separable convex minimization with linear constraints
• Multiplier and gradient methods
• Exact matrix completion via convex optimization
• Linear Convergence of the Alternating Direction Method of Multipliers for a Class of Convex Optimization Problems
• Constrained Total Variation Deblurring Models and Fast Algorithms Based on Alternating Direction Method of Multipliers
• On the $O(1/n)$ Convergence Rate of the Douglas–Rachford Alternating Direction Method
• Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming
• A Convergent $3$-Block Semi-Proximal ADMM for Convex Minimization Problems with One Strongly Convex Block
• Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problems
• Improved Pointwise Iteration-Complexity of A Regularized ADMM and of a Regularized Non-Euclidean HPE Framework
• Recovering Low-Rank and Sparse Components of Matrices from Incomplete and Noisy Observations
• Robust principal component analysis?
• Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Łojasiewicz Inequality
• An augmented Lagrangian based parallel splitting method for separable convex minimization with applications to image processing
• On the Numerical Solution of Heat Conduction Problems in Two and Three Space Variables
• Asymptotic Convergence Analysis of the Proximal Point Algorithm
• On Full Jacobian Decomposition of the Augmented Lagrangian Method for Separable Convex Programming
• Global Convergence of Splitting Methods for Nonconvex Composite Optimization
• Clarke Subgradients of Stratifiable Functions
• Implicit Functions and Solution Mappings
• Characterizations of Łojasiewicz inequalities: Subgradient flows, talweg, convexity
• From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
• Splitting Algorithms for the Sum of Two Nonlinear Operators
• Monotone Operators and the Proximal Point Algorithm
• Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming
• Variational Analysis
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Sparse Signal Estimation by Maximally Sparse Convex Optimization
• On the Linear Convergence of the ADMM in Decentralized Consensus Optimization
• The Convergence Guarantees of a Non-Convex Approach for Sparse Recovery
• Multi-Agent Distributed Optimization via Inexact Consensus ADMM
• An alternating direction method of multipliers with a worst-case $O(1/n^2)$ convergence rate
• Finite-Dimensional Variational Inequalities and Complementarity Problems
• A simple proof for some important properties of the projection mapping
• De-noising by soft-thresholding
• The Linearized Alternating Direction Method of Multipliers for Dantzig Selector
• Linearized augmented Lagrangian and alternating direction methods for nuclear norm minimization
• Convergence of alternating direction method for minimizing sum of two nonconvex functions with linear constraints
• Metric Subregularity of Piecewise Linear Multifunctions and Applications to Piecewise Linear Multiobjective Optimization
• Rate of Convergence Analysis of Decomposition Methods Based on the Proximal Method of Multipliers for Convex Minimization
• A Proximal Alternating Direction Method of Multiplier for Linearly Constrained Nonconvex Minimization
• Fast Alternating Direction Optimization Methods
• Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming
• An Accelerated Linearized Alternating Direction Method of Multipliers
• The Primal-Dual Hybrid Gradient Method for Semiconvex Splittings
• On Alternating Direction Methods of Multipliers: A Historical Perspective
• Convergence Analysis of Douglas--Rachford Splitting Method for “Strongly + Weakly” Convex Programming
• Iteration-Complexity of Block-Decomposition Algorithms and the Alternating Direction Method of Multipliers
• Local Linear Convergence of the Alternating Direction Method of Multipliers for Quadratic Programs
• Local Linear Convergence of the Alternating Direction Method of Multipliers on Quadratic or Linear Programs
• The Łojasiewicz Inequality for Nonsmooth Subanalytic Functions with Applications to Subgradient Dynamical Systems
• Model Selection and Estimation in Regression with Grouped Variables
• Convergence of the Iterates of Descent Methods for Analytic Cost Functions
• On the Global Linear Convergence of the ADMM with MultiBlock Variables
• A descent method for structured monotone variational inequalities
• Convex analysis and monotone operator theory in Hilbert spaces
• A new accuracy criterion for approximate proximal point algorithms
• The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent
• A partially parallel splitting method for multiple-block separable convex programming with applications to robust PCA
• A distributed Douglas-Rachford splitting method for multi-block convex minimization problems
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: A survey on some recent developments of alternating direction method of multipliers