Convergence rates for an inexact ADMM applied to separable convex optimization
From MaRDI portal
Publication:2023686
Abstract: Convergence rates are established for an inexact accelerated alternating direction method of multipliers (I-ADMM) for general separable convex optimization with a linear constraint. Both ergodic and non-ergodic iterates are analyzed. Relative to the iteration number k, the convergence rate is O(1/k) in a convex setting and O(1/k^2) in a strongly convex setting. When an error bound condition holds, the algorithm is 2-step linearly convergent. The I-ADMM is designed so that the accuracy of the inexact iteration preserves the global convergence rates of the exact iteration, leading to better numerical performance in the test problems.
Recommendations
- Inexact generalized proximal alternating direction methods of multipliers and their convergence rates
- The convergence rate analysis of the symmetric ADMM for the nonconvex separable optimization problems
- Accelerated alternating direction method of multipliers: an optimal \(O(1 / K)\) nonergodic analysis
- Inexact alternating direction methods of multipliers for separable convex optimization
- An inexact proximal generalized alternating direction method of multipliers
Cites work
- A convergent 3-block semi-proximal ADMM for convex minimization problems with one strongly convex block
- A dual algorithm for the solution of nonlinear variational problems via finite element approximation
- A new inexact alternating directions method for monotone variational inequalities
- A note on the alternating direction method of multipliers
- A practical relative error criterion for augmented Lagrangians
- A proximal-based deomposition method for compositions method for convex minimization problems
- A three-operator splitting scheme and its optimization applications
- Alternating direction augmented Lagrangian methods for semidefinite programming
- Alternating direction method with Gaussian back substitution for separable convex programming
- An \(\mathcal O(1/{k})\) convergence rate for the variable stepsize Bregman operator splitting algorithm
- An alternating direction-based contraction method for linearly constrained separable convex programming problems
- An efficient inexact symmetric Gauss-Seidel based majorized ADMM for high-dimensional convex composite conic programming
- An inexact hybrid generalized proximal point algorithm and some new results on the theory of Bregman functions
- Approximate ADMM algorithms derived from Lagrangian splitting
- Bregman operator splitting with variable stepsize for total variation image reconstruction
- Convergence analysis of positive-indefinite proximal ADMM with a Glowinski's relaxation factor
- Discerning the linear convergence of ADMM for structured convex optimization through the lens of variational analysis
- Distributed optimization and statistical learning via the alternating direction method of multipliers
- Fast multiple-splitting algorithms for convex optimization
- scientific article; zbMATH DE number 3919744 (Why is no real title available?)
- scientific article; zbMATH DE number 2121575 (Why is no real title available?)
- Inexact alternating direction methods of multipliers for separable convex optimization
- Inexact alternating direction methods of multipliers with logarithmic-quadratic proximal regularization
- Iteration-complexity of block-decomposition algorithms and the alternating direction method of multipliers
- Linear convergence of the alternating direction method of multipliers for a class of convex optimization problems
- Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming
- Modified Lagrangians in convex programming and their generalizations
- Monotone Operators and the Proximal Point Algorithm
- On the \(O(1/n)\) convergence rate of the Douglas-Rachford alternating direction method
- On the convergence analysis of the alternating direction method of multipliers with three blocks
- On the convergence of the direct extension of ADMM for three-block separable convex minimization models with one strongly convex function
- On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators
- On the Global Linear Convergence of the ADMM with MultiBlock Variables
- On the linear convergence of the alternating direction method of multipliers
- Optimally linearizing the alternating direction method of multipliers for convex programming
- Partial error bound conditions and the linear convergence rate of the alternating direction method of multipliers
- Rate of Convergence Analysis of Decomposition Methods Based on the Proximal Method of Multipliers for Convex Minimization
- Recovering Low-Rank and Sparse Components of Matrices from Incomplete and Noisy Observations
- Relative-error approximate versions of Douglas-Rachford splitting and special cases of the ADMM
- Some continuity properties of polyhedral multifunctions
- The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent
Cited in
(15)- Convergence of the augmented decomposition algorithm
- A parallel splitting ALM-based algorithm for separable convex programming
- An inexact ADMM with proximal-indefinite term and larger stepsize
- An inexact accelerated stochastic ADMM for separable convex optimization
- Parametrized inexact-ADMM based coordination games: a normalized Nash equilibrium approach
- SI-ADMM: A Stochastic Inexact ADMM Framework for Stochastic Convex Programs
- Inexact generalized proximal alternating direction methods of multipliers and their convergence rates
- Convergence Rate Analysis for the Alternating Direction Method of Multipliers with a Substitution Procedure for Separable Convex Programming
- A partially inexact ADMM with o(1/n) asymptotic convergence rate, 𝒪(1/n) complexity, and immediate relative error tolerance
- A variable projection method for large-scale inverse problems with \(\ell^1\) regularization
- A linear algebra perspective on the random multi-block ADMM: the QP case
- Convergence rates for an inexact linearized ADMM for nonsmooth nonconvex optimization with nonlinear equality constraints
- An inexact ADMM for separable nonconvex and nonsmooth optimization
- Projective splitting with backward, half-forward and proximal-Newton steps
- A relative-error inexact ADMM splitting algorithm for convex optimization with inertial effects
This page was built for publication: Convergence rates for an inexact ADMM applied to separable convex optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2023686)