Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian

DOI10.1007/s00245-023-09997-xzbMath1522.37096arXiv2203.05457OpenAlexW4280511288MaRDI QIDQ6166341

Hassan Riahi, Hedy Attouch, Aicha Balhag, Zaki Chbani

Publication date: 6 July 2023

Published in: Applied Mathematics and Optimization (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2203.05457

zbMATH Keywords

convex optimizationHessian-driven dampinghierarchical minimizationaccelerated gradient methodsdamped inertial dynamicsNesterov accelerated gradient methodTikhonov approximation

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25) Numerical optimization and variational techniques (65K10) Management decision making, including multiple objectives (90B50) Applications of functional analysis in optimization, convex analysis, mathematical programming, economics (46N10) Dynamical systems in optimization and economics (37N40) Numerical solution of inverse problems involving ordinary differential equations (65L09) Numerical methods for variational inequalities and related problems (65K15) Numerical solution of ill-posed problems involving ordinary differential equations (65L08)

Related Items

Fast convergence of inertial dynamics with Hessian-driven damping under geometry assumptions, On the strong convergence of continuous Newton-like inertial dynamics with Tikhonov regularization for monotone inclusions, Strong Convergence of Trajectories via Inertial Dynamics Combining Hessian-Driven Damping and Tikhonov Regularization for General Convex Minimizations, A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Fast convex optimization via inertial dynamics with Hessian driven damping
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• Inertial gradient-like dynamical system controlled by a stabilizing term
• On an asymptotically autonomous system with Tikhonov type regularizing term
• Asymptotic behavior of gradient-like dynamical systems involving inertia and multiscale aspects
• Asymptotic selection of viscosity equilibria of semilinear evolution equations by the introduction of a slowly vanishing term
• Strong asymptotic convergence of evolution equations governed by maximal monotone operators with Tikhonov regularization
• Introductory lectures on convex optimization. A basic course.
• Asymptotic control and stabilization of nonlinear oscillators with non-isolated equilibria
• Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
• A dynamical approach to convex minimization coupling approximation with the steepest descent method
• Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution
• Understanding the acceleration phenomenon via high-resolution differential equations
• Asymptotic for a second order evolution equation with damping and regularizing terms
• First-order optimization algorithms via inertial systems with Hessian driven damping
• Tikhonov regularization of a second order dynamical system with Hessian driven damping
• Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces
• Asymptotic behavior of coupled dynamical systems with multiscale aspects
• Combining fast inertial dynamics for convex optimization with Tikhonov regularization
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• Newton-type inertial algorithms for solving monotone equations Governed by sums of potential and nonpotential operators
• A dynamic approach to a proximal-Newton method for monotone inclusions in Hilbert spaces, with complexity O(1/n^2)
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• A Continuous Dynamical Newton-Like Approach to Solving Monotone Inclusions
• A General Framework for a Class of First Order Primal-Dual Algorithms for Convex Optimization in Imaging Science
• On the long time behavior of second order differential equations with asymptotically small dissipation
• Practical Aspects of the Moreau--Yosida Regularization: Theoretical Preliminaries
• The Differential Inclusion Modeling FISTA Algorithm and Optimality of Convergence Rate in the Case b $\leq3$
• Viscosity Solutions of Minimization Problems
• From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective
• Proximal Point Algorithm Controlled by a Slowly Vanishing Term: Applications to Hierarchical Minimization
• Some methods of speeding up the convergence of iteration methods
• Convex analysis and monotone operator theory in Hilbert spaces
• A convergence result for nonautonomous subgradient evolution equations and its application to the steepest descent exponential penalty trajectory in linear programming
• Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping
• Fast optimization via inertial dynamics with closed-loop damping