Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping

DOI10.1137/19M1307779zbMath1452.65103OpenAlexW3048765741MaRDI QIDQ5116552

Hedy Attouch, Samir Adly

Publication date: 18 August 2020

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/19m1307779

zbMATH Keywords

differential inclusionfinite convergenceHessian-driven dampinginertial methodsLasso problemproximal-gradient algorithms

Mathematics Subject Classification ID

Ordinary differential inclusions (34A60) Evolution inclusions (34G25) Problems involving a system of particles with friction (70F40) Numerical solution to inverse problems in abstract spaces (65J22)

Related Items (19)

Asymptotic behavior of Newton-like inertial dynamics involving the sum of potential and nonpotential terms ⋮ On a second-order functional evolution problem with time and state dependent maximal monotone operators ⋮ On fractional evolution inclusion coupled with a time and state dependent maximal monotone operator ⋮ From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective ⋮ Newton-type inertial algorithms for solving monotone equations Governed by sums of potential and nonpotential operators ⋮ Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping ⋮ Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations ⋮ Unnamed Item ⋮ Fast convergence of inertial dynamics with Hessian-driven damping under geometry assumptions ⋮ Second-order problems involving time-dependent subdifferential operators and application to control ⋮ A generalized inertial proximal alternating linearized minimization method for nonconvex nonsmooth problems ⋮ Accelerated smoothing hard thresholding algorithms for \(\ell_0\) regularized nonsmooth convex regression problem ⋮ First order inertial optimization algorithms with threshold effects associated with dry friction ⋮ Smoothing accelerated proximal gradient method with fast convergence rate for nonsmooth convex optimization beyond differentiability ⋮ Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping ⋮ Fast optimization via inertial dynamics with closed-loop damping ⋮ A control-theoretic perspective on optimal high-order optimization ⋮ On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping ⋮ Set-valued perturbation to second-order evolution problems with time-dependent subdifferential operators

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Fast convex optimization via inertial dynamics with Hessian driven damping
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• A note on the dynamics of an oscillator in the presence of strong friction.
• Introductory lectures on convex optimization. A basic course.
• Rate of convergence of inertial gradient dynamics with time-dependent viscous damping coefficient
• Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
• Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• An inertial proximal algorithm with dry friction: finite convergence results
• Second Order Forward-Backward Dynamical Systems For Monotone Inclusion Problems
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• Variational Analysis in Sobolev and BV Spaces
• A Variational Approach to Nonsmooth Dynamics
• Stability of Over-Relaxations for the Forward-Backward Algorithm, Application to FISTA
• Practical Aspects of the Moreau--Yosida Regularization: Theoretical Preliminaries
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• THE HEAVY BALL WITH FRICTION METHOD, I. THE CONTINUOUS DYNAMICAL SYSTEM: GLOBAL EXPLORATION OF THE LOCAL MINIMA OF A REAL-VALUED FUNCTION BY ASYMPTOTIC ANALYSIS OF A DISSIPATIVE DYNAMICAL SYSTEM
• Convergence Rates of Inertial Forward-Backward Algorithms
• Asymptotic for a second-order evolution equation with convex potential andvanishing damping term
• Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
• A second-order dynamical approach with variable damping to nonconvex smooth minimization
• A second-order dynamical system with Hessian-driven damping and penalty term associated to variational inequalities
• Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics
• Regularized HPE-Type Methods for Solving Monotone Inclusions with Improved Pointwise Iteration-Complexity Bounds
• Some methods of speeding up the convergence of iteration methods
• An introduction to continuous optimization for imaging
• Convex analysis and monotone operator theory in Hilbert spaces
• Benchmarking optimization software with performance profiles.

This page was built for publication: Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping