On the strong convergence of the trajectories of a Tikhonov regularized second order dynamical system with asymptotically vanishing damping

DOI10.1016/J.JDE.2023.03.014MaRDI QIDQ6042664zbMATH OpenOpenAlexFDO

Authors Szilárd László

Publication date 3 May 2023

Published in Journal of Differential Equations (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2202.08980

zbMATH Keywords

convex optimizationconvergence ratestrong convergencecontinuous second-order dynamical system\) Tikhonov regularizationasymptotics as \(t \to \infty

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Convex programming (90C25) Nonlinear programming (90C30) Asymptotic properties of solutions to ordinary differential equations (34D05) Nonlinear differential equations in abstract spaces (34G20) Perturbations, asymptotics of solutions to ordinary differential equations (34E10)

Abstract: This paper deals with a second order dynamical system with vanishing damping that contains a Tikhonov regularization term, in connection to the minimization problem of a convex Fr'echet differentiable function $g$. We show that for appropriate Tikhonov regularization parameters the value of the objective function in a generated trajectory converges fast to the global minimum of the objective function and a trajectory generated by the dynamical system converges weakly to a minimizer of the objective function. We also obtain the fast convergence of the velocities towards zero and some integral estimates. Nevertheless, our main goal is to extend and improve some recent results obtained in cite{ABCR} and cite{AL-nemkoz} concerning the strong convergence of the generated trajectories to an element of minimal norm from the $argmin$ set of the objective function $g$. Our analysis also reveals that the damping coefficient and the Tikhonov regularization coefficient are strongly correlated.

Recommendations

• Tikhonov regularization of a perturbed heavy ball system with vanishing damping
• Tikhonov regularization of a second order dynamical system with Hessian driven damping
• On the convergence of a class of inertial dynamical systems with Tikhonov regularization
• Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution
• Combining fast inertial dynamics for convex optimization with Tikhonov regularization

Cites work

• scientific article; zbMATH DE number 3850830 (Why is no real title available?)
• scientific article; zbMATH DE number 3863589 (Why is no real title available?)
• A differential equation for modeling Nesterov's accelerated gradient method: theory and insights
• A dynamical approach to convex minimization coupling approximation with the steepest descent method
• A second-order dynamical approach with variable damping to nonconvex smooth minimization
• An extension of the second order dynamical system that models Nesterov's convex gradient method
• Asymptotic control and stabilization of nonlinear oscillators with non-isolated equilibria
• Asymptotic for a second-order evolution equation with convex potential and vanishing damping term
• Asymptotic for the perturbed heavy ball system with vanishing damping term
• Asymptotics for a second-order differential equation with nonautonomous damping and an integrable source term
• Combining fast inertial dynamics for convex optimization with Tikhonov regularization
• Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators
• Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule
• Convergence rates for an inertial algorithm of gradient type associated to a smooth non-convex minimization
• Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• Fast convex optimization via inertial dynamics with Hessian driven damping
• Inducing strong convergence of trajectories in dynamical systems associated to monotone inclusions with composite structure
• Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces
• On the long time behavior of second order differential equations with asymptotically small dissipation
• Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
• Strong asymptotic convergence of evolution equations governed by maximal monotone operators with Tikhonov regularization
• The rate of convergence of Nesterov's accelerated forward-backward method is actually faster than \(1/k^2\)
• Tikhonov regularization of a perturbed heavy ball system with vanishing damping
• Tikhonov regularization of a second order dynamical system with Hessian driven damping

Cited in

(22)

• Asymptotics for a dissipative dynamical system with linear and gradient-driven damping
• On the convergence of a class of inertial dynamical systems with Tikhonov regularization
• Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution
• Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping
• Convex optimization via inertial algorithms with vanishing Tikhonov regularization: fast convergence to the minimum norm solution
• A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique
• A Nesterov type algorithm with double Tikhonov regularization: fast convergence of the function values and strong convergence to the minimal norm solution
• The second-order in time continuous Newton method
• On an asymptotically autonomous system with Tikhonov type regularizing term
• On the strong convergence of continuous Newton-like inertial dynamics with Tikhonov regularization for monotone inclusions
• Second order dynamics featuring Tikhonov regularization and time scaling
• Fast convergence rate of values with strong convergence of trajectories via inertial dynamics with Tikhonov regularization terms and asymptotically vanishing damping
• Tikhonov regularization of a second order dynamical system with Hessian driven damping
• On damped second-order gradient systems
• Solving convex optimization problems via a second order dynamical system with implicit Hessian damping and Tikhonov regularization
• Fast convergence of inertial gradient dynamics with multiscale aspects
• Tikhonov regularization of a perturbed heavy ball system with vanishing damping
• Fast convergence rates and trajectory convergence of a Tikhonov regularized inertial primal-dual dynamical system with time scaling and vanishing damping
• Optimizing properties of an inertial dynamical system with geometric damping. Link with proximal methods
• Strong Convergence of Trajectories via Inertial Dynamics Combining Hessian-Driven Damping and Tikhonov Regularization for General Convex Minimizations
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• Second-order dynamical systems associated to variational inequalities

This page was built for publication: On the strong convergence of the trajectories of a Tikhonov regularized second order dynamical system with asymptotically vanishing damping

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6042664)