Convergence Analysis of Primal-Dual Algorithms for a Saddle-Point Problem: From Contraction Perspective
From MaRDI portal
Publication:2912264
DOI10.1137/100814494zbMath1250.90066OpenAlexW2021548137MaRDI QIDQ2912264
Publication date: 14 September 2012
Published in: SIAM Journal on Imaging Sciences (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1137/100814494
total variationprimal-dual methodcontraction methodimage restorationproximal point algorithmsaddle-point problem
Convex programming (90C25) Numerical optimization and variational techniques (65K10) Numerical solution to inverse problems in abstract spaces (65J22)
Related Items
A new randomized primal-dual algorithm for convex optimization with fast last iterate convergence rates ⋮ New Primal-Dual Algorithms for a Class of Nonsmooth and Nonlinear Convex-Concave Minimax Problems ⋮ Partial Smoothness and Constant Rank ⋮ Unnamed Item ⋮ On the Convergence of Stochastic Primal-Dual Hybrid Gradient ⋮ An extended primal-dual algorithm framework for nonconvex problems: application to image reconstruction in spectral CT ⋮ Golden Ratio Primal-Dual Algorithm with Linesearch ⋮ A Generalized Primal-Dual Algorithm with Improved Convergence Condition for Saddle Point Problems ⋮ 3D diffeomorphic image registration with Cauchy–Riemann constraint and lower bounded deformation divergence ⋮ Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists ⋮ Some extensions of the operator splitting schemes based on Lagrangian and primal–dual: a unified proximal point analysis ⋮ An inexact primal-dual method with correction step for a saddle point problem in image debluring ⋮ A partially inexact generalized primal-dual hybrid gradient method for saddle point problems with bilinear couplings ⋮ Two convergent primal-dual hybrid gradient type methods for convex programming with linear constraints ⋮ Proximal Activation of Smooth Functions in Splitting Algorithms for Convex Image Recovery ⋮ A denoising model based on the fractional Beltrami regularization and its numerical solution ⋮ Inertial, Corrected, Primal-Dual Proximal Splitting ⋮ Linearly convergent bilevel optimization with single-step inner methods ⋮ Understanding the convergence of the preconditioned PDHG method: a view of indefinite proximal ADMM ⋮ Resolvent splitting for sums of monotone operators with minimal lifting ⋮ A two-stage numerical approach for the sparse initial source identification of a diffusion–advection equation * ⋮ A second order primal-dual dynamical system for a convex-concave bilinear saddle point problem ⋮ Unnamed Item ⋮ An accelerated primal-dual iterative scheme for the L 2 -TV regularized model of linear inverse problems ⋮ Higher-order total variation approaches and generalisations ⋮ An alternating direction method of multipliers with a worst-case $O(1/n^2)$ convergence rate ⋮ Multilevel Optimal Transport: A Fast Approximation of Wasserstein-1 Distances ⋮ Nonlinear Forward-Backward Splitting with Projection Correction ⋮ A Coordinate-Descent Primal-Dual Algorithm with Large Step Size and Possibly Nonseparable Functions ⋮ Alternating Direction Method of Multipliers for Linear Inverse Problems ⋮ Local linear convergence analysis of Primal–Dual splitting methods ⋮ Total Variation Regularization Strategies in Full-Waveform Inversion ⋮ Forward-Backward-Half Forward Algorithm for Solving Monotone Inclusions ⋮ A Distributed ADMM-like Method for Resource Sharing over Time-Varying Networks ⋮ Data-Driven Nonsmooth Optimization ⋮ Non-stationary First-Order Primal-Dual Algorithms with Faster Convergence Rates ⋮ RECENT ADVANCES IN DOMAIN DECOMPOSITION METHODS FOR TOTAL VARIATION MINIMIZATION ⋮ Preconditioned proximal point methods and notions of partial subregularity ⋮ Solving inverse problems using data-driven models ⋮ An Accelerated Linearized Alternating Direction Method of Multipliers ⋮ Approximate first-order primal-dual algorithms for saddle point problems ⋮ Regularisation, optimisation, subregularity ⋮ Split-Douglas--Rachford Algorithm for Composite Monotone Inclusions and Split-ADMM ⋮ A primal-dual flow for affine constrained convex optimization ⋮ Degenerate Preconditioned Proximal Point Algorithms ⋮ Local saddle points for unconstrained polynomial optimization ⋮ Diffusion tensor imaging with deterministic error bounds ⋮ Fixed point algorithm based on adapted metric method for convex minimization problem with application to image deblurring ⋮ Partial Error Bound Conditions and the Linear Convergence Rate of the Alternating Direction Method of Multipliers ⋮ ADMM for monotone operators: convergence analysis and rates ⋮ Accelerated gradient sliding for structured convex optimization ⋮ Inertial Proximal ADMM for Linearly Constrained Separable Convex Optimization ⋮ A Convex Approach for Image Restoration with Exact Poisson--Gaussian Likelihood ⋮ On the ergodic convergence rates of a first-order primal-dual algorithm ⋮ A customized proximal point algorithm for convex minimization with linear constraints ⋮ Vector and Matrix Optimal Mass Transport: Theory, Algorithm, and Applications ⋮ Monotone operator theory in convex optimization ⋮ Unbalanced and partial \(L_1\) Monge-Kantorovich problem: a scalable parallel first-order method ⋮ The saddle point problem of polynomials ⋮ On the linear convergence of the general first order primal-dual algorithm ⋮ Asymmetric forward-backward-adjoint splitting for solving monotone inclusions involving three operators ⋮ A splitting primal-dual proximity algorithm for solving composite optimization problems ⋮ Convergence analysis of primal-dual based methods for total variation minimization with finite element approximation ⋮ A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms ⋮ On the convergence of recursive SURE for total variation minimization ⋮ An improved first-order primal-dual algorithm with a new correction step ⋮ A primal-dual algorithm framework for convex saddle-point optimization ⋮ Unified linear convergence of first-order primal-dual algorithms for saddle point problems ⋮ Preconditioned three-operator splitting algorithm with applications to image restoration ⋮ Convergence Rate Analysis of Primal-Dual Splitting Schemes ⋮ An inertial forward-backward algorithm for monotone inclusions ⋮ Discrete total variation with finite elements and applications to imaging ⋮ The matrix splitting based proximal fixed-point algorithms for quadratically constrained \(\ell_{1}\) minimization and Dantzig selector ⋮ On relaxation of some customized proximal point algorithms for convex minimization: from variational inequality perspective ⋮ Primal-dual fixed point algorithm based on adapted metric method for solving convex minimization problem with application ⋮ A 2D diffeomorphic image registration model with inequality constraint ⋮ A generalized forward-backward splitting operator: degenerate analysis and applications ⋮ A Smooth Primal-Dual Optimization Framework for Nonsmooth Composite Convex Minimization ⋮ Testing and non-linear preconditioning of the proximal point method ⋮ A modified Chambolle-Pock primal-dual algorithm for Poisson noise removal ⋮ Alternating split Bregman method for the bilaterally constrained image deblurring problem ⋮ Smoothed \(\ell_1\)-regularization-based line search for sparse signal recovery ⋮ An algorithmic framework of generalized primal-dual hybrid gradient methods for saddle point problems ⋮ Image restoration based on the minimized surface regularization ⋮ Solving saddle point problems: a landscape of primal-dual algorithm with larger stepsizes ⋮ Primal-dual splittings as fixed point iterations in the range of linear operators ⋮ Acceleration of the PDHGM on partially strongly convex functions ⋮ A First-Order Primal-Dual Algorithm with Linesearch ⋮ A splitting algorithm for dual monotone inclusions involving cocoercive operators ⋮ Compressive Sensing ⋮ Accelerated Uzawa methods for convex optimization ⋮ Bregman three-operator splitting methods ⋮ The Moreau envelope approach for the L1/TV image denoising model ⋮ A dual-primal balanced augmented Lagrangian method for linearly constrained convex programming ⋮ An alternative extrapolation scheme of PDHGM for saddle point problem with nonlinear function ⋮ A double extrapolation primal-dual algorithm for saddle point problems ⋮ Primal-dual hybrid gradient method for distributionally robust optimization problems ⋮ A projected primal-dual method for solving constrained monotone inclusions ⋮ The auxiliary problem principle with self-adaptive penalty parameter for multi-area economic dispatch problem ⋮ A first-order inexact primal-dual algorithm for a class of convex-concave saddle point problems ⋮ Accelerated proximal point method for maximally monotone operators ⋮ A fast proximal point algorithm for \(\ell_{1}\)-minimization problem in compressed sensing ⋮ A parallel method for earth mover's distance ⋮ A preconditioning technique for first-order primal-dual splitting method in convex optimization ⋮ Nonsymmetric proximal point algorithm with moving proximal centers for variational inequalities: convergence analysis ⋮ Convergent non-overlapping domain decomposition methods for variational image segmentation ⋮ Fractional-order total variation image restoration based on primal-dual algorithm ⋮ A primal-dual multiplier method for total variation image restoration ⋮ A prediction-correction-based primal-dual hybrid gradient method for linearly constrained convex minimization ⋮ The distance between convex sets with Minkowski sum structure: application to collision detection ⋮ A golden ratio primal-dual algorithm for structured convex optimization ⋮ Decomposition and discrete approximation methods for solving two-stage distributionally robust optimization problems ⋮ Acceleration of primal-dual methods by preconditioning and simple subproblem procedures ⋮ A class of customized proximal point algorithms for linearly constrained convex optimization ⋮ A primal-dual prediction-correction algorithm for saddle point optimization ⋮ A phase model using the Huber norm for estimating point spread function under frozen flow hypothesis ⋮ On the equivalence of the primal-dual hybrid gradient method and Douglas-Rachford splitting ⋮ Primal-dual splitting method for high-order model with application to image restoration ⋮ Distributed and consensus optimization for non-smooth image reconstruction ⋮ Semisupervised data classification via the Mumford-Shah-Potts-type model ⋮ Customized proximal point algorithms for linearly constrained convex minimization and saddle-point problems: a unified approach ⋮ A parallel splitting ALM-based algorithm for separable convex programming ⋮ Easily Parallelizable and Distributable Class of Algorithms for Structured Sparsity, with Optimal Acceleration ⋮ A proximal point algorithm with asymmetric linear term ⋮ Robust linear neural network for constrained quadratic optimization ⋮ Convergence analysis of a variable metric forward-backward splitting algorithm with applications ⋮ Bregman primal-dual first-order method and application to sparse semidefinite programming ⋮ A new implementable prediction-correction method for monotone variational inequalities with separable structure ⋮ Non-stationary Douglas-Rachford and alternating direction method of multipliers: adaptive step-sizes and convergence ⋮ Block-proximal methods with spatially adapted acceleration ⋮ Improved Lagrangian-PPA based prediction correction method for linearly constrained convex optimization ⋮ Wavelet inpainting by fractional order total variation ⋮ Convergence results of two-step inertial proximal point algorithm ⋮ A Peaceman-Rachford splitting method with monotone plus skew-symmetric splitting for nonlinear saddle point problems ⋮ Convergence analysis of an inexact three-operator splitting algorithm ⋮ A modified primal-dual method with applications to some sparse recovery problems ⋮ A proximal-gradient algorithm for crystal surface evolution ⋮ An efficient primal dual prox method for non-smooth optimization ⋮ A relaxed parameter condition for the primal-dual hybrid gradient method for saddle-point problem ⋮ Robust optimization in power systems: a tutorial overview ⋮ GRPDA revisited: relaxed condition and connection to Chambolle-Pock's primal-dual algorithm ⋮ On convergence of the Arrow-Hurwicz method for saddle point problems ⋮ Multi-step fixed-point proximity algorithms for solving a class of optimization problems arising from image processing ⋮ Perturbation techniques for convergence analysis of proximal gradient method and other first-order algorithms via variational analysis ⋮ PPA-like contraction methods for convex optimization: a framework using variational inequality approach