Convergence Rates of Inertial Forward-Backward Algorithms

DOI10.1137/17M1114739zbMath1387.49047MaRDI QIDQ4609474

Alexandre Cabot, Hedy Attouch

Publication date: 3 April 2018

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

zbMATH Keywords

structured convex optimizationNesterov methodaccelerated gradient methodFISTAinertial forward-backward algorithmsvanishing dampingproximal-based methods

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25) Numerical methods based on nonlinear programming (49M37)

Related Items (59)

Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling ⋮ Convergence results of a new monotone inertial forward-backward splitting algorithm under the local Hölder error bound condition ⋮ Accelerated methods with fastly vanishing subgradients for structured non-smooth minimization ⋮ First-order optimization algorithms via inertial systems with Hessian driven damping ⋮ First-order inertial algorithms involving dry friction damping ⋮ Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics ⋮ The rate of convergence of optimization algorithms obtained via discretizations of heavy ball dynamical systems for convex optimization problems ⋮ Improving “Fast Iterative Shrinkage-Thresholding Algorithm”: Faster, Smarter, and Greedier ⋮ Fast proximal algorithms for nonsmooth convex optimization ⋮ First-order frameworks for continuous Newton-like dynamics governed by maximally monotone operators ⋮ From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective ⋮ Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping ⋮ Fast augmented Lagrangian method in the convex regime with convergence guarantees for the iterates ⋮ Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations ⋮ Unnamed Item ⋮ Convergence rate of inertial proximal algorithms with general extrapolation and proximal coefficients ⋮ Nonlinear forward-backward splitting with momentum correction ⋮ Double inertial parameters forward-backward splitting method: Applications to compressed sensing, image processing, and SCAD penalty problems ⋮ Unnamed Item ⋮ Inertial algorithms for a system of equilibrium problems and fixed point problems ⋮ Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3 ⋮ Behavior of accelerated gradient methods near critical points of nonconvex functions ⋮ Convergence rate of a relaxed inertial proximal algorithm for convex minimization ⋮ A proximal subgradient algorithm with extrapolation for structured nonconvex nonsmooth problems ⋮ Inertial, Corrected, Primal-Dual Proximal Splitting ⋮ A class of modified accelerated proximal gradient methods for nonsmooth and nonconvex minimization problems ⋮ First order inertial optimization algorithms with threshold effects associated with dry friction ⋮ Modified inertial projection and contraction algorithms with non-monotonic step sizes for solving variational inequalities and their applications ⋮ Convergence rates of the heavy-ball method under the Łojasiewicz property ⋮ Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping ⋮ On a new simple algorithm to compute the resolvents ⋮ Fast optimization via inertial dynamics with closed-loop damping ⋮ Inertial proximal point algorithms for solving a class of split feasibility problems ⋮ Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES* ⋮ An accelerated forward-backward-half forward splitting algorithm for monotone inclusion with applications to image restoration ⋮ Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping ⋮ On FISTA with a relative error rule ⋮ Convergence of a relaxed inertial proximal algorithm for maximally monotone operators ⋮ Applying FISTA to optimization problems (with or) without minimizers ⋮ Newton-like Inertial Dynamics and Proximal Algorithms Governed by Maximally Monotone Operators ⋮ Inertial forward-backward algorithms with perturbations: application to Tikhonov regularization ⋮ Convergence Rates of Damped Inertial Dynamics under Geometric Conditions and Perturbations ⋮ Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping ⋮ Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators ⋮ An explicit algorithm for solving monotone variational inequalities ⋮ Convergence rates of an inertial gradient descent algorithm under growth and flatness conditions ⋮ Continuous Newton-like inertial dynamics for monotone inclusions ⋮ Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule ⋮ New analysis of linear convergence of gradient-type methods via unifying error bound conditions ⋮ Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics ⋮ Weak and strong convergence of inertial algorithms for solving split common fixed point problems ⋮ Some modified fast iterative shrinkage thresholding algorithms with a new adaptive non-monotone stepsize strategy for nonsmooth and convex minimization problems ⋮ Understanding the acceleration phenomenon via high-resolution differential equations ⋮ From differential equation solvers to accelerated first-order methods for convex optimization ⋮ Convergence rates for the heavy-ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition ⋮ Convergence of a relaxed inertial forward-backward algorithm for structured monotone inclusions ⋮ ON THE STRONG CONVERGENCE OF A PROJECTION-BASED ALGORITHM IN HILBERT SPACES ⋮ Tikhonov Regularization of a Perturbed Heavy Ball System with Vanishing Damping ⋮ Fast convex optimization via a third-order in time evolution equation

Cites Work

• Unnamed Item
• Unnamed Item
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Optimized first-order methods for smooth convex minimization
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• Asymptotics for some proximal-like method involving inertia and memory aspects
• An inertial forward-backward algorithm for monotone inclusions
• Asymptotic convergence of nonlinear contraction semigroups in Hilbert space
• Un exemple concernant le comportement asymptotique de la solution du problème \(du/dt+\partial\varphi(\mu)\ni=0\)
• Produits infinis de resolvantes
• Introductory lectures on convex optimization. A basic course.
• Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
• On damped second-order gradient systems
• Adaptive restart for accelerated gradient schemes
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• The Remarkable Effectiveness of Time-Dependent Damping Terms for Second Order Evolution Equations
• Second Order Forward-Backward Dynamical Systems For Monotone Inclusion Problems
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• Accelerated and Inexact Forward-Backward Algorithms
• Stability of Over-Relaxations for the Forward-Backward Algorithm, Application to FISTA
• On the Long Time Behavior of Second Order Differential Equations with Asymptotically Small Dissipation
• On the long time behavior of second order differential equations with asymptotically small dissipation
• On the Convergence of the Proximal Point Algorithm for Convex Minimization
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• Asymptotic for a second-order evolution equation with convex potential andvanishing damping term
• A Dynamical Approach to an Inertial Forward-Backward Algorithm for Convex Minimization
• Asymptotics for a second-order differential equation with nonautonomous damping and an integrable source term
• Signal Recovery by Proximal Forward-Backward Splitting
• Some methods of speeding up the convergence of iteration methods
• Weak convergence of the sequence of successive approximations for nonexpansive mappings
• Convex analysis and monotone operator theory in Hilbert spaces
• An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping

This page was built for publication: Convergence Rates of Inertial Forward-Backward Algorithms