Tikhonov regularization of a second order dynamical system with Hessian driven damping

DOI10.1007/S10107-020-01528-8zbMath1489.34088arXiv1911.12845OpenAlexW3035316500MaRDI QIDQ2230936

Radu Ioan Boţ, Szilárd Csaba László, Ernö Robert Csetnek

Publication date: 29 September 2021

Published in: Mathematical Programming. Series A. Series B (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1911.12845

zbMATH Keywords

convex optimizationTikhonov regularizationHessian-driven dampingsecond-order dynamical systemfast convergence methods

Mathematics Subject Classification ID

Convex programming (90C25) Monotone operators and generalizations (47H05) Iterative procedures involving nonlinear operators (47J25) Initial value problems, existence, uniqueness, continuous dependence and continuation of solutions to ordinary differential equations (34A12) Nonlinear differential equations in abstract spaces (34G20) Asymptotic properties of solutions to ordinary differential equations (34D05) Perturbations, asymptotics of solutions to ordinary differential equations (34E10)

Related Items (34)

Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling ⋮ Asymptotic behavior of Newton-like inertial dynamics involving the sum of potential and nonpotential terms ⋮ The rate of convergence of optimization algorithms obtained via discretizations of heavy ball dynamical systems for convex optimization problems ⋮ From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective ⋮ Newton-type inertial algorithms for solving monotone equations Governed by sums of potential and nonpotential operators ⋮ Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping ⋮ On the strong convergence of the trajectories of a Tikhonov regularized second order dynamical system with asymptotically vanishing damping ⋮ Fast convergence of inertial dynamics with Hessian-driven damping under geometry assumptions ⋮ On the strong convergence of continuous Newton-like inertial dynamics with Tikhonov regularization for monotone inclusions ⋮ Strong Convergence of Trajectories via Inertial Dynamics Combining Hessian-Driven Damping and Tikhonov Regularization for General Convex Minimizations ⋮ Inertial Newton algorithms avoiding strict saddle points ⋮ First order inertial optimization algorithms with threshold effects associated with dry friction ⋮ A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique ⋮ Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping ⋮ Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian ⋮ Fast optimization via inertial dynamics with closed-loop damping ⋮ Continuous Newton-like Methods Featuring Inertia and Variable Mass ⋮ Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES* ⋮ Fast convergence of inertial gradient dynamics with multiscale aspects ⋮ Special issue: Continuous optimization and stability analysis ⋮ Convex optimization via inertial algorithms with vanishing Tikhonov regularization: fast convergence to the minimum norm solution ⋮ Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping ⋮ A Nesterov type algorithm with double Tikhonov regularization: fast convergence of the function values and strong convergence to the minimal norm solution ⋮ Novel regularized dynamical systems for solving hierarchical fixed point problems ⋮ Solving convex optimization problems via a second order dynamical system with implicit Hessian damping and Tikhonov regularization ⋮ Fast optimization of charged particle dynamics with damping ⋮ Second order dynamics featuring Tikhonov regularization and time scaling ⋮ Fast convergence rate of values with strong convergence of trajectories via inertial dynamics with Tikhonov regularization terms and asymptotically vanishing damping ⋮ Fast convex optimization via differential equation with Hessian-driven damping and Tikhonov regularization ⋮ On the convergence of a class of inertial dynamical systems with Tikhonov regularization ⋮ Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution ⋮ Tikhonov Regularization of a Perturbed Heavy Ball System with Vanishing Damping ⋮ Fast convex optimization via a third-order in time evolution equation ⋮ On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping

Cites Work

• Unnamed Item
• Fast convex optimization via inertial dynamics with Hessian driven damping
• Global convergence of a closed-loop regularized Newton method for solving monotone inclusions in Hilbert spaces
• Asymptotic selection of viscosity equilibria of semilinear evolution equations by the introduction of a slowly vanishing term
• Strong asymptotic convergence of evolution equations governed by maximal monotone operators with Tikhonov regularization
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• Asymptotic control and stabilization of nonlinear oscillators with non-isolated equilibria
• A dynamical approach to convex minimization coupling approximation with the steepest descent method
• Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces
• Combining fast inertial dynamics for convex optimization with Tikhonov regularization
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• A Continuous Dynamical Newton-Like Approach to Solving Monotone Inclusions
• On the long time behavior of second order differential equations with asymptotically small dissipation
• Viscosity Solutions of Minimization Problems
• Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
• Dynamics of evolutionary equations

This page was built for publication: Tikhonov regularization of a second order dynamical system with Hessian driven damping