Fast primal-dual algorithm via dynamical system for a linearly constrained convex optimization problem
From MaRDI portal
Publication:2097697
DOI10.1016/J.AUTOMATICA.2022.110547zbMATH Open1504.93281arXiv2103.10118OpenAlexW4287265721WikidataQ114204722 ScholiaQ114204722MaRDI QIDQ2097697FDOQ2097697
Publication date: 14 November 2022
Published in: Automatica (Search for Journal in Brave)
Abstract: By time discretization of a second-order primal-dual dynamical system with damping where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a linear equality constrained convex optimization problem. Under a suitable scaling condition, we show that the proposed algorithm enjoys a fast convergence rate for the objective residual and the feasibility violation, and the decay rate can reach at the most. We also study convergence properties of the corresponding primal-dual dynamical system to better understand the acceleration scheme. Finally, we report numerical experiments to demonstrate the effectiveness of the proposed algorithm.
Full work available at URL: https://arxiv.org/abs/2103.10118
Recommendations
- Inertial accelerated primal-dual methods for linear equality constrained convex optimization problems
- Convergence rates of inertial primal-dual dynamical methods for separable convex optimization problems
- Fast augmented Lagrangian method in the convex regime with convergence guarantees for the iterates
- Time rescaling of a primal-dual dynamical system with asymptotically vanishing damping
- Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping
convergence rateprimal-dual algorithmNesterov's accelerationinertial primal-dual dynamical systemlinearly constrained convex optimization problem
Cites Work
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers
- Title not available (Why is that?)
- Bregmanized nonlocal regularization for deconvolution and sparse reconstruction
- Title not available (Why is that?)
- Title not available (Why is that?)
- A differential equation for modeling Nesterov's accelerated gradient method: theory and insights
- Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication
- Stability of primal-dual gradient dynamics and applications to network optimization
- Accelerated linearized Bregman method
- Accelerated Bregman method for linearly constrained \(\ell _1-\ell _2\) minimization
- Inexact accelerated augmented Lagrangian methods
- Accelerated First-Order Primal-Dual Proximal Methods for Linearly Constrained Composite Convex Programming
- Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
- A variational perspective on accelerated methods in optimization
- A primal-dual flow for affine constrained convex optimization
- DYNAMICAL, SYMPLECTIC AND STOCHASTIC PERSPECTIVES ON GRADIENT-BASED OPTIMIZATION
- Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics
- Title not available (Why is that?)
- Exponential convergence of distributed primal-dual convex optimization algorithm without strong convexity
- Accelerated Optimization for Machine Learning
- Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics
- Inertial accelerated primal-dual methods for linear equality constrained convex optimization problems
- Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping
- Exponential stability of partial primal-dual gradient dynamics with nonsmooth objective functions
- Convergence Rates of Inertial Primal-Dual Dynamical Methods for Separable Convex Optimization Problems
Cited In (10)
- Accelerated primal-dual methods with adaptive parameters for composite convex optimization with linear constraints
- Fast augmented Lagrangian method in the convex regime with convergence guarantees for the iterates
- Time rescaling of a primal-dual dynamical system with asymptotically vanishing damping
- A second order primal-dual dynamical system for a convex-concave bilinear saddle point problem
- Non-ergodic convergence rate of an inertial accelerated primal-dual algorithm for saddle point problems
- Fast convergence rates and trajectory convergence of a Tikhonov regularized inertial primal-dual dynamical system with time scaling and vanishing damping
- Inertial accelerated augmented Lagrangian algorithms with scaling coefficients to solve exactly and inexactly linearly constrained convex optimization problems
- Fast convergence of the primal-dual dynamical system and corresponding algorithms for a nonsmooth bilinearly coupled saddle point problem
- Distributed continuous-time accelerated neurodynamic approaches for sparse recovery via smooth approximation to \(L_1\)-minimization
- Inertial primal-dual dynamics with damping and scaling for linearly constrained convex optimization problems
This page was built for publication: Fast primal-dual algorithm via dynamical system for a linearly constrained convex optimization problem
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2097697)