Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES*
From MaRDI portal
Publication:6192080
Abstract: In a Hilbert space setting H, for convex optimization, we analyze the fast convergence properties as t tends to infinity of the trajectories generated by a third-order in time evolution system. The function f to minimize is supposed to be convex, continuously differentiable, with a nonempty set of minimizers. It enters into the dynamic through its gradient. Based on this new dynamical system, we improve the results obtained by [Attouch, Chbani, Riahi: Fast convex optimization via a third-order in time evolution equation, Optimization 2020]. As a main result, when the damping parameter satisfies , we show that the convergence of the values at the order 1/t3 as t goes to infinity, as well as the convergence of the trajectories. We complement these results by introducing into the dynamic an Hessian driven damping term, which reduces the oscillations. In the case of a strongly convex function f, we show an autonomous evolution system of the third order in time with an exponential rate of convergence. All these results have natural extensions to the case of a convex lower semicontinuous function with extended real values. Just replace f with its Moreau envelope.
Recommendations
- Fast convex optimization via a third-order in time evolution equation
- Fast convex optimization via inertial dynamics with Hessian driven damping
- Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling
- Fast convex optimization via differential equation with Hessian-driven damping and Tikhonov regularization
- Fast convex optimization via time scaling of damped inertial gradient dynamics
Cites work
- scientific article; zbMATH DE number 48893 (Why is no real title available?)
- A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
- Asymptotic for a second-order evolution equation with convex potential and vanishing damping term
- Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
- Convergence rate of a relaxed inertial proximal algorithm for convex minimization
- Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule
- Convergence rates of inertial forward-backward algorithms
- Convex analysis and monotone operator theory in Hilbert spaces
- Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics
- Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
- Fast convex optimization via a third-order in time evolution equation
- Fast convex optimization via inertial dynamics with Hessian driven damping
- Fast convex optimization via time scaling of damped inertial gradient dynamics
- First-order optimization algorithms via inertial systems with Hessian driven damping
- On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
- Rate of convergence of inertial gradient dynamics with time-dependent viscous damping coefficient
- Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
- Stability of over-relaxations for the forward-backward algorithm, application to FISTA
- The rate of convergence of Nesterov's accelerated forward-backward method is actually faster than \(1/k^2\)
- Tikhonov regularization of a second order dynamical system with Hessian driven damping
- Variational Analysis in Sobolev andBVSpaces
This page was built for publication: Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES*
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6192080)
