Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity

DOI10.1016/J.JDE.2017.06.024zbMath1405.37092OpenAlexW2735979640MaRDI QIDQ1785926

Hedy Attouch, Alexandre Cabot

Publication date: 2 October 2018

Published in: Journal of Differential Equations (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.jde.2017.06.024

zbMATH Keywords

convex optimizationasymptotic stabilizationvanishing viscosityLyapunov analysisfast gradient methodinertial gradient dynamics

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25) Numerical optimization and variational techniques (65K10) Management decision making, including multiple objectives (90B50) Perturbations of ordinary differential equations (34D10) Oscillation theory, zeros, disconjugacy and comparison theory for ordinary differential equations (34C10) Applications of functional analysis in optimization, convex analysis, mathematical programming, economics (46N10) Dynamical systems in optimization and economics (37N40) Stabilization of solutions to ordinary differential equations (34H15)

Related Items (43)

Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling ⋮ Asymptotic for a second order evolution equation with damping and regularizing terms ⋮ First-order optimization algorithms via inertial systems with Hessian driven damping ⋮ First-order inertial algorithms involving dry friction damping ⋮ Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics ⋮ The rate of convergence of optimization algorithms obtained via discretizations of heavy ball dynamical systems for convex optimization problems ⋮ Fast inertial dynamic algorithm with smoothing method for nonsmooth convex optimization ⋮ Convergence Rates of the Heavy Ball Method for Quasi-strongly Convex Optimization ⋮ From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective ⋮ A new minimizing-movements scheme for curves of maximal slope ⋮ Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations ⋮ Unnamed Item ⋮ Inertial primal-dual dynamics with damping and scaling for linearly constrained convex optimization problems ⋮ Convergence rate of inertial proximal algorithms with general extrapolation and proximal coefficients ⋮ Unnamed Item ⋮ Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3 ⋮ Convergence rates of the heavy-ball method under the Łojasiewicz property ⋮ Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian ⋮ Fast optimization via inertial dynamics with closed-loop damping ⋮ Continuous Newton-like Methods Featuring Inertia and Variable Mass ⋮ Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES* ⋮ Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping ⋮ Optimal decay rates for semi-linear non-autonomous evolution equations with vanishing damping ⋮ Fast convergence of inertial gradient dynamics with multiscale aspects ⋮ Convergence Rates of Inertial Forward-Backward Algorithms ⋮ Convergence of damped inertial dynamics governed by regularized maximally monotone operators ⋮ Rate of convergence of inertial gradient dynamics with time-dependent viscous damping coefficient ⋮ Inertial forward-backward algorithms with perturbations: application to Tikhonov regularization ⋮ Convergence Rates of Damped Inertial Dynamics under Geometric Conditions and Perturbations ⋮ Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping ⋮ Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators ⋮ Second-Order Dynamics with Hessian-Driven Damping for Linearly Constrained Convex Minimization ⋮ Optimal Convergence Rates for Nesterov Acceleration ⋮ Convergence Rates of Inertial Primal-Dual Dynamical Methods for Separable Convex Optimization Problems ⋮ Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics ⋮ Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution ⋮ A control-theoretic perspective on optimal high-order optimization ⋮ Convergence rates for the heavy-ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition ⋮ Convergence rates of damped inerial dynamics from multi-degree-of-freedom system ⋮ Two structure-preserving time discretizations for gradient flows ⋮ A Class of Second-Order Geometric Quasilinear Hyperbolic PDEs and Their Application in Imaging ⋮ Fast convex optimization via a third-order in time evolution equation ⋮ On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• Asymptotics for some semilinear hyperbolic equations with non-autonomous damping
• Asymptotic convergence of nonlinear contraction semigroups in Hilbert space
• Convergence of solutions to second-order gradient-like systems with analytic nonlinearities
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• Introductory lectures on convex optimization. A basic course.
• On damped second-order gradient systems
• Adaptive restart for accelerated gradient schemes
• The Remarkable Effectiveness of Time-Dependent Damping Terms for Second Order Evolution Equations
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• The Convergence Problem for Dissipative Autonomous Systems
• Asymptotics for a gradient system with memory term
• On the Long Time Behavior of Second Order Differential Equations with Asymptotically Small Dissipation
• On the long time behavior of second order differential equations with asymptotically small dissipation
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• THE HEAVY BALL WITH FRICTION METHOD, I. THE CONTINUOUS DYNAMICAL SYSTEM: GLOBAL EXPLORATION OF THE LOCAL MINIMA OF A REAL-VALUED FUNCTION BY ASYMPTOTIC ANALYSIS OF A DISSIPATIVE DYNAMICAL SYSTEM
• A Dynamical Approach to an Inertial Forward-Backward Algorithm for Convex Minimization
• Asymptotics for a second-order differential equation with nonautonomous damping and an integrable source term
• Some methods of speeding up the convergence of iteration methods
• Weak convergence of the sequence of successive approximations for nonexpansive mappings

This page was built for publication: Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity