Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity

DOI10.1016/j.jde.2017.06.024zbMath1405.37092OpenAlexW2735979640MaRDI QIDQ1785926

Hedy Attouch, Alexandre Cabot

Publication date: 2 October 2018

Published in: Journal of Differential Equations (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.jde.2017.06.024

zbMATH Keywords

convex optimizationasymptotic stabilizationvanishing viscosityLyapunov analysisfast gradient methodinertial gradient dynamics

Mathematics Subject Classification ID

Related Items (43)

Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling ⋮ Asymptotic for a second order evolution equation with damping and regularizing terms ⋮ First-order optimization algorithms via inertial systems with Hessian driven damping ⋮ First-order inertial algorithms involving dry friction damping ⋮ Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics ⋮ The rate of convergence of optimization algorithms obtained via discretizations of heavy ball dynamical systems for convex optimization problems ⋮ Fast inertial dynamic algorithm with smoothing method for nonsmooth convex optimization ⋮ Convergence Rates of the Heavy Ball Method for Quasi-strongly Convex Optimization ⋮ From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective ⋮ A new minimizing-movements scheme for curves of maximal slope ⋮ Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations ⋮ Unnamed Item ⋮ Inertial primal-dual dynamics with damping and scaling for linearly constrained convex optimization problems ⋮ Convergence rate of inertial proximal algorithms with general extrapolation and proximal coefficients ⋮ Unnamed Item ⋮ Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3 ⋮ Convergence rates of the heavy-ball method under the Łojasiewicz property ⋮ Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian ⋮ Fast optimization via inertial dynamics with closed-loop damping ⋮ Continuous Newton-like Methods Featuring Inertia and Variable Mass ⋮ Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES* ⋮ Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping ⋮ Optimal decay rates for semi-linear non-autonomous evolution equations with vanishing damping ⋮ Fast convergence of inertial gradient dynamics with multiscale aspects ⋮ Convergence Rates of Inertial Forward-Backward Algorithms ⋮ Convergence of damped inertial dynamics governed by regularized maximally monotone operators ⋮ Rate of convergence of inertial gradient dynamics with time-dependent viscous damping coefficient ⋮ Inertial forward-backward algorithms with perturbations: application to Tikhonov regularization ⋮ Convergence Rates of Damped Inertial Dynamics under Geometric Conditions and Perturbations ⋮ Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping ⋮ Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators ⋮ Second-Order Dynamics with Hessian-Driven Damping for Linearly Constrained Convex Minimization ⋮ Optimal Convergence Rates for Nesterov Acceleration ⋮ Convergence Rates of Inertial Primal-Dual Dynamical Methods for Separable Convex Optimization Problems ⋮ Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics ⋮ Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution ⋮ A control-theoretic perspective on optimal high-order optimization ⋮ Convergence rates for the heavy-ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition ⋮ Convergence rates of damped inerial dynamics from multi-degree-of-freedom system ⋮ Two structure-preserving time discretizations for gradient flows ⋮ A Class of Second-Order Geometric Quasilinear Hyperbolic PDEs and Their Application in Imaging ⋮ Fast convex optimization via a third-order in time evolution equation ⋮ On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• Asymptotics for some semilinear hyperbolic equations with non-autonomous damping
• Asymptotic convergence of nonlinear contraction semigroups in Hilbert space
• Convergence of solutions to second-order gradient-like systems with analytic nonlinearities
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• Introductory lectures on convex optimization. A basic course.
• On damped second-order gradient systems
• Adaptive restart for accelerated gradient schemes
• The Remarkable Effectiveness of Time-Dependent Damping Terms for Second Order Evolution Equations
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• The Convergence Problem for Dissipative Autonomous Systems
• Asymptotics for a gradient system with memory term
• On the Long Time Behavior of Second Order Differential Equations with Asymptotically Small Dissipation
• On the long time behavior of second order differential equations with asymptotically small dissipation
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• THE HEAVY BALL WITH FRICTION METHOD, I. THE CONTINUOUS DYNAMICAL SYSTEM: GLOBAL EXPLORATION OF THE LOCAL MINIMA OF A REAL-VALUED FUNCTION BY ASYMPTOTIC ANALYSIS OF A DISSIPATIVE DYNAMICAL SYSTEM
• A Dynamical Approach to an Inertial Forward-Backward Algorithm for Convex Minimization
• Asymptotics for a second-order differential equation with nonautonomous damping and an integrable source term
• Some methods of speeding up the convergence of iteration methods
• Weak convergence of the sequence of successive approximations for nonexpansive mappings

This page was built for publication: Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity