On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm

DOI10.1007/s10957-015-0746-4zbMath1371.65047OpenAlexW322738573MaRDI QIDQ495742

Publication date: 15 September 2015

Published in: Journal of Optimization Theory and Applications (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s10957-015-0746-4

zbMATH Keywords

optimization convergence first-order schemes forward backward splitting inertial algorithms

Mathematics Subject Classification ID

Convex programming (90C25) Numerical solutions to equations with nonlinear operators (65J15) Complexity and performance of numerical algorithms (65Y20)

Related Items

Relaxed inertial methods for solving the split monotone variational inclusion problem beyond co-coerciveness ⋮ Inertial algorithm with self-adaptive step size for split common null point and common fixed point problems for multivalued mappings in Banach spaces ⋮ An inertial projection and contraction method with a line search technique for variational inequality and fixed point problems ⋮ The rate of convergence of optimization algorithms obtained via discretizations of heavy ball dynamical systems for convex optimization problems ⋮ Exact gradient methods with memory ⋮ Improving “Fast Iterative Shrinkage-Thresholding Algorithm”: Faster, Smarter, and Greedier ⋮ From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective ⋮ Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping ⋮ ``FISTA in Banach spaces with adaptive discretisations ⋮ Fast augmented Lagrangian method in the convex regime with convergence guarantees for the iterates ⋮ Proximal Splitting Algorithms for Convex Optimization: A Tour of Recent Advances, with New Twists ⋮ Nesterov's Method for Convex Optimization ⋮ Tomographic reconstruction from Poisson distributed data: a fast and convergent EM-TV dual approach ⋮ An accelerated proximal gradient method for multiobjective optimization ⋮ Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations ⋮ Unnamed Item ⋮ A self-adaptive inertial subgradient extragradient algorithm for solving bilevel equilibrium problems ⋮ Double inertial parameters forward-backward splitting method: Applications to compressed sensing, image processing, and SCAD penalty problems ⋮ Unnamed Item ⋮ Alternated and multi-step inertial approximation methods for solving convex bilevel optimization problems ⋮ Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3 ⋮ FISTA is an automatic geometrically optimized algorithm for strongly convex functions ⋮ No-regret algorithms in on-line learning, games and convex optimization ⋮ Continuum Limits of Nonlocal $p$-Laplacian Variational Problems on Graphs ⋮ Proximal Activation of Smooth Functions in Splitting Algorithms for Convex Image Recovery ⋮ Convergence rate of a relaxed inertial proximal algorithm for convex minimization ⋮ A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems ⋮ Modified inertial projection and contraction algorithms with non-monotonic step sizes for solving variational inequalities and their applications ⋮ Smoothing accelerated proximal gradient method with fast convergence rate for nonsmooth convex optimization beyond differentiability ⋮ A local MM subspace method for solving constrained variational problems in image recovery ⋮ Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping ⋮ A forward-backward algorithm with different inertial terms for structured non-convex minimization problems ⋮ On a new simple algorithm to compute the resolvents ⋮ Time rescaling of a primal-dual dynamical system with asymptotically vanishing damping ⋮ Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian ⋮ Explainable bilevel optimization: an application to the Helsinki Deblur Challenge ⋮ Fast optimization via inertial dynamics with closed-loop damping ⋮ Strong convergence results of split equality hierarchical fixed point problems ⋮ From Halpern's fixed-point iterations to Nesterov's accelerated interpretations for root-finding problems ⋮ Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES* ⋮ Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping ⋮ Convergence of Inexact Forward--Backward Algorithms Using the Forward--Backward Envelope ⋮ A generic online acceleration scheme for optimization algorithms via relaxation and inertia ⋮ A projected gradient method for αℓ ₁ − βℓ ₂ sparsity regularization ^** ⋮ Newton-like Inertial Dynamics and Proximal Algorithms Governed by Maximally Monotone Operators ⋮ Solve the split equality problem by a projection algorithm with inertial effects ⋮ A Coordinate-Descent Primal-Dual Algorithm with Large Step Size and Possibly Nonseparable Functions ⋮ Fast convergence of generalized forward-backward algorithms for structured monotone inclusions ⋮ An introduction to continuous optimization for imaging ⋮ Inertial Variable Metric Techniques for the Inexact Forward--Backward Algorithm ⋮ A forward–backward penalty scheme with inertial effects for monotone inclusions. Applications to convex bilevel programming ⋮ Convergence Theorems and Convergence Rates for the General Inertial Krasnosel’skiǐ–Mann Algorithm ⋮ Optimal Convergence Rates for Nesterov Acceleration ⋮ A second-order dynamical approach with variable damping to nonconvex smooth minimization ⋮ A remark on accelerated block coordinate descent for computing the proximity operators of a sum of convex functions ⋮ Quantitative Convergence Analysis of Iterated Expansive, Set-Valued Mappings ⋮ A viscosity-proximal gradient method with inertial extrapolation for solving certain minimization problems in Hilbert space ⋮ Backtracking Strategies for Accelerated Descent Methods with Smooth Composite Objectives ⋮ Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics ⋮ Modified inertial subgradient extragradient method with self adaptive stepsize for solving monotone variational inequality and fixed point problems ⋮ Scalable Bayesian Uncertainty Quantification in Imaging Inverse Problems via Convex Optimization ⋮ Accelerated Iterative Regularization via Dual Diagonal Descent ⋮ Generalized Momentum-Based Methods: A Hamiltonian Perspective ⋮ Group Sparse Optimization for Images Recovery Using Capped Folded Concave Functions ⋮ Tikhonov Regularization of a Perturbed Heavy Ball System with Vanishing Damping ⋮ Fast convex optimization via a third-order in time evolution equation ⋮ Scaled, Inexact, and Adaptive Generalized FISTA for Strongly Convex Optimization ⋮ Proximal Gradient Methods for Machine Learning and Imaging ⋮ An inertial Mann algorithm for nonexpansive mappings ⋮ Convergence results of a new monotone inertial forward-backward splitting algorithm under the local Hölder error bound condition ⋮ Nonsmoothness in machine learning: specific structure, proximal identification, and applications ⋮ New inertial projection methods for solving multivalued variational inequality problems beyond monotonicity ⋮ Accelerated methods with fastly vanishing subgradients for structured non-smooth minimization ⋮ Accelerated proximal algorithms with a correction term for monotone inclusions ⋮ First-order optimization algorithms via inertial systems with Hessian driven damping ⋮ First-order inertial algorithms involving dry friction damping ⋮ Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics ⋮ An inertial S-iteration process ⋮ Convergence analysis of two-step inertial Douglas-Rachford algorithm and application ⋮ Stability of Over-Relaxations for the Forward-Backward Algorithm, Application to FISTA ⋮ Decomposition Methods for Sparse Matrix Nearness Problems ⋮ Accelerating $\ell^1$-$\ell^2$ deblurring using wavelet expansions of operators ⋮ Fast convex optimization via inertial dynamics with Hessian driven damping ⋮ Sensitivity Analysis for Mirror-Stratifiable Convex Functions ⋮ Iterative Methods for the Elastography Inverse Problem of Locating Tumors ⋮ Monotone operator theory in convex optimization ⋮ Bounded perturbation resilience of the viscosity algorithm ⋮ Fast inertial dynamic algorithm with smoothing method for nonsmooth convex optimization ⋮ Generalizing the Optimized Gradient Method for Smooth Convex Minimization ⋮ Adaptive restart of the optimized gradient method for convex optimization ⋮ Iterative method with inertial terms for nonexpansive mappings: applications to compressed sensing ⋮ New convergence results for the inexact variable metric forward-backward method ⋮ Inertial proximal alternating minimization for nonconvex and nonsmooth problems ⋮ Combining fast inertial dynamics for convex optimization with Tikhonov regularization ⋮ Convex optimization approach to signals with fast varying instantaneous frequency ⋮ Accelerated additive Schwarz methods for convex optimization with adaptive restart ⋮ A gradient-type algorithm with backward inertial steps associated to a nonconvex minimization problem ⋮ A refined convergence analysis of $\mathrm{pDCA}_{e}$ with applications to simultaneous sparse recovery and outlier detection ⋮ General inertial proximal gradient method for a class of nonconvex nonsmooth optimization problems ⋮ Simultaneous and semi-alternating projection algorithms for solving split equality problems ⋮ Convergence rate of inertial proximal algorithms with general extrapolation and proximal coefficients ⋮ Alternating forward-backward splitting for linearly constrained optimization problems ⋮ Quasi-Nonexpansive Iterations on the Affine Hull of Orbits: From Mann's Mean Value Algorithm to Inertial Methods ⋮ An unexpected connection between Bayes $A$-optimal designs and the group Lasso ⋮ Linear Convergence of Proximal Gradient Algorithm with Extrapolation for a Class of Nonconvex Nonsmooth Minimization Problems ⋮ Behavior of accelerated gradient methods near critical points of nonconvex functions ⋮ Another Look at the Fast Iterative Shrinkage/Thresholding Algorithm (FISTA) ⋮ Smoothed $\ell_1$-regularization-based line search for sparse signal recovery ⋮ Activity Identification and Local Linear Convergence of Forward--Backward-type Methods ⋮ Matrix completion for matrices with low-rank displacement ⋮ Accelerated alternating descent methods for Dykstra-like problems ⋮ The Differential Inclusion Modeling FISTA Algorithm and Optimality of Convergence Rate in the Case b $\leq3$ ⋮ Inertial projection and contraction algorithms for variational inequalities ⋮ On FISTA with a relative error rule ⋮ A smoothing proximal gradient algorithm with extrapolation for the relaxation of ${\ell_0}$ regularization problem ⋮ Applying FISTA to optimization problems (with or) without minimizers ⋮ Convergence Rates of Inertial Forward-Backward Algorithms ⋮ Convergence of damped inertial dynamics governed by regularized maximally monotone operators ⋮ Rate of convergence of inertial gradient dynamics with time-dependent viscous damping coefficient ⋮ Variable smoothing for convex optimization problems using stochastic gradients ⋮ Optimization methods for regularization-based ill-posed problems: a survey and a multi-objective framework ⋮ Variable metric techniques for forward-backward methods in imaging ⋮ Energy-stable staggered schemes for the shallow water equations ⋮ Convergence of first-order methods via the convex conjugate ⋮ Inertial forward-backward algorithms with perturbations: application to Tikhonov regularization ⋮ Convergence Rates of Damped Inertial Dynamics under Geometric Conditions and Perturbations ⋮ Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping ⋮ Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators ⋮ Accelerated proximal point method for maximally monotone operators ⋮ Convergence rates for an inertial algorithm of gradient type associated to a smooth non-convex minimization ⋮ Modified inertial Mann algorithm and inertial CQ-algorithm for nonexpansive mappings ⋮ On the proximal gradient algorithm with alternated inertia ⋮ A self adaptive inertial subgradient extragradient algorithm for variational inequality and common fixed point of multivalued mappings in Hilbert spaces ⋮ A fast splitting method for efficient split Bregman iterations ⋮ On the convergence of the iterates of proximal gradient algorithm with extrapolation for convex nonsmooth minimization problems ⋮ Local and global convergence of a general inertial proximal splitting scheme for minimizing composite functions ⋮ Convergence rates of an inertial gradient descent algorithm under growth and flatness conditions ⋮ On starting and stopping criteria for nested primal-dual iterations ⋮ On the interplay between acceleration and identification for the proximal gradient algorithm ⋮ Calculus of the exponent of Kurdyka-Łojasiewicz inequality and its applications to linear convergence of first-order methods ⋮ Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity ⋮ Lagrangian penalization scheme with parallel forward-backward splitting ⋮ Variable smoothing for weakly convex composite functions ⋮ A block coordinate variable metric linesearch based proximal gradient method ⋮ Functional penalised basis pursuit on spheres ⋮ Strongly convex optimization for joint fractal feature estimation and texture segmentation ⋮ A unified algorithm for solving split generalized mixed equilibrium problem, and for finding fixed point of nonspreading mapping in Hilbert spaces ⋮ Variable Metric Inexact Line-Search-Based Methods for Nonsmooth Optimization ⋮ An Efficient Inexact ABCD Method for Least Squares Semidefinite Programming ⋮ Continuous Newton-like inertial dynamics for monotone inclusions ⋮ Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule ⋮ Convergence of relaxed inertial subgradient extragradient methods for quasimonotone variational inequality problems ⋮ The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$ ⋮ A Variable Metric Forward-Backward Method with Extrapolation ⋮ Maximal spaces for approximation rates in $\ell^1$-regularization ⋮ Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution ⋮ Strong convergence of an inertial projection and contraction method with self adaptive stepsize for pseudomonotone variational inequalities and fixed point problems ⋮ Convergence rates of forward-Douglas-Rachford splitting method ⋮ The extragradient algorithm with inertial effects for solving the variational inequality ⋮ A self adaptive inertial algorithm for solving split variational inclusion and fixed point problems with applications ⋮ Application of a new accelerated algorithm to regression problems ⋮ Some modified fast iterative shrinkage thresholding algorithms with a new adaptive non-monotone stepsize strategy for nonsmooth and convex minimization problems ⋮ Limited-memory common-directions method for large-scale optimization: convergence, parallelization, and distributed optimization ⋮ Understanding the acceleration phenomenon via high-resolution differential equations ⋮ Convergence rates of damped inerial dynamics from multi-degree-of-freedom system ⋮ Convergence of a relaxed inertial forward-backward algorithm for structured monotone inclusions ⋮ On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping ⋮ A nested primal-dual FISTA-like scheme for composite convex optimization problems

Uses Software

UNLocBoX

Cites Work