Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES*

DOI10.1080/02331934.2022.2119084arXiv2007.03062OpenAlexW3038979072MaRDI QIDQ6192080FDOQ6192080

Authors: Hédy Attouch, Z. Chbani, H. Riahi 

Publication date: 11 March 2024

Published in: Optimization (Search for Journal in Brave)

Abstract: In a Hilbert space setting H, for convex optimization, we analyze the fast convergence properties as t tends to infinity of the trajectories generated by a third-order in time evolution system. The function f to minimize is supposed to be convex, continuously differentiable, with a nonempty set of minimizers. It enters into the dynamic through its gradient. Based on this new dynamical system, we improve the results obtained by [Attouch, Chbani, Riahi: Fast convex optimization via a third-order in time evolution equation, Optimization 2020]. As a main result, when the damping parameter $alpha$ satisfies $alpha>3$, we show that the convergence of the values at the order 1/t3 as t goes to infinity, as well as the convergence of the trajectories. We complement these results by introducing into the dynamic an Hessian driven damping term, which reduces the oscillations. In the case of a strongly convex function f, we show an autonomous evolution system of the third order in time with an exponential rate of convergence. All these results have natural extensions to the case of a convex lower semicontinuous function with extended real values. Just replace f with its Moreau envelope.

Full work available at URL: https://arxiv.org/abs/2007.03062

Recommendations

• Fast convex optimization via a third-order in time evolution equation
• Fast convex optimization via inertial dynamics with Hessian driven damping
• Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling
• Fast convex optimization via differential equation with Hessian-driven damping and Tikhonov regularization
• Fast convex optimization via time scaling of damped inertial gradient dynamics

zbMATH Keywords

convex optimizationLyapunov analysisfast convergencetime rescalingaccelerated gradient system

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25)

Cites Work

• Convex analysis and monotone operator theory in Hilbert spaces
• Variational Analysis in Sobolev andBVSpaces
• Title not available (Why is that?)
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• Fast convex optimization via inertial dynamics with Hessian driven damping
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• The rate of convergence of Nesterov's accelerated forward-backward method is actually faster than \(1/k^2\)
• Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
• First-order optimization algorithms via inertial systems with Hessian driven damping
• Stability of over-relaxations for the forward-backward algorithm, application to FISTA
• Rate of convergence of inertial gradient dynamics with time-dependent viscous damping coefficient
• Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
• Asymptotic for a second-order evolution equation with convex potential and vanishing damping term
• Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule
• Convergence rates of inertial forward-backward algorithms
• Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics
• Tikhonov regularization of a second order dynamical system with Hessian driven damping
• Convergence rate of a relaxed inertial proximal algorithm for convex minimization
• Fast convex optimization via time scaling of damped inertial gradient dynamics
• Fast convex optimization via a third-order in time evolution equation

Cited In (1)

• Third order dynamical systems for the sum of two generalized monotone operators

This page was built for publication: Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES*

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6192080)