Combining fast inertial dynamics for convex optimization with Tikhonov regularization

DOI10.1016/j.jmaa.2016.12.017zbMath1375.65080arXiv1602.01973OpenAlexW2964153427MaRDI QIDQ2408626

Hassan Riahi, Zaki Chbani, Hedy Attouch

Publication date: 12 October 2017

Published in: Journal of Mathematical Analysis and Applications (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1602.01973

zbMATH Keywords

convergenceconvex optimizationvanishing viscosityTikhonov regularizationinertial dynamicshierarchical minimizationNesterov accelerated gradient methodTikhonov approximation

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25)

Related Items (25)

Continuous dynamics related to monotone inclusions and non-smooth optimization problems ⋮ Inducing strong convergence of trajectories in dynamical systems associated to monotone inclusions with composite structure ⋮ Asymptotic for a second order evolution equation with damping and regularizing terms ⋮ On the strong convergence of the trajectories of a Tikhonov regularized second order dynamical system with asymptotically vanishing damping ⋮ On the strong convergence of continuous Newton-like inertial dynamics with Tikhonov regularization for monotone inclusions ⋮ Novel projection neurodynamic approaches for constrained convex optimization ⋮ Strong Convergence of Trajectories via Inertial Dynamics Combining Hessian-Driven Damping and Tikhonov Regularization for General Convex Minimizations ⋮ Practical perspectives on symplectic accelerated optimization ⋮ Unnamed Item ⋮ A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique ⋮ Time rescaling of a primal-dual dynamical system with asymptotically vanishing damping ⋮ Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian ⋮ Fast convergence of inertial gradient dynamics with multiscale aspects ⋮ Inertial forward-backward algorithms with perturbations: application to Tikhonov regularization ⋮ Tikhonov regularization of a second order dynamical system with Hessian driven damping ⋮ Inertial hybrid splitting methods for operator inclusion problems ⋮ An inertial forward-backward splitting method for solving inclusion problems in Hilbert spaces ⋮ On the convergence of the iterates of proximal gradient algorithm with extrapolation for convex nonsmooth minimization problems ⋮ On the convergence of a class of inertial dynamical systems with Tikhonov regularization ⋮ Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics ⋮ Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution ⋮ Convergence rates of first- and higher-order dynamics for solving linear ill-posed problems ⋮ Accelerated Iterative Regularization via Dual Diagonal Descent ⋮ A Class of Second-Order Geometric Quasilinear Hyperbolic PDEs and Their Application in Imaging ⋮ Tikhonov Regularization of a Perturbed Heavy Ball System with Vanishing Damping

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Smooth minimization of non-smooth functions
• Gradient methods for minimizing composite functions
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• On an asymptotically autonomous system with Tikhonov type regularizing term
• A strongly convergent primal-dual method for nonoverlapping domain decomposition
• Forward-backward and Tseng's type penalty schemes for monotone inclusion problems
• Asymptotic selection of viscosity equilibria of semilinear evolution equations by the introduction of a slowly vanishing term
• Strong asymptotic convergence of evolution equations governed by maximal monotone operators with Tikhonov regularization
• Strong convergence theorems for resolvents of accretive operators in Banach spaces
• Asymptotic convergence of nonlinear contraction semigroups in Hilbert space
• Convergence of solutions to second-order gradient-like systems with analytic nonlinearities
• Coupling the proximal point algorithm with approximation methods
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• Introductory lectures on convex optimization. A basic course.
• Asymptotic control and stabilization of nonlinear oscillators with non-isolated equilibria
• A dynamical approach to convex minimization coupling approximation with the steepest descent method
• Adaptive restart for accelerated gradient schemes
• Asymptotic behavior of coupled dynamical systems with multiscale aspects
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• Convex Optimization in Normed Spaces
• A Liapunov function approach to the stabilization of second order coupled systems
• Prox-Penalization and Splitting Methods for Constrained Variational Problems
• Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time
• A Parallel Splitting Method for Coupled Monotone Inclusions
• Coupling Forward-Backward with Penalty Schemes and Parallel Splitting for Constrained Variational Inequalities
• On the long time behavior of second order differential equations with asymptotically small dissipation
• Convergence and asymptotic stabilization for some damped hyperbolic equations with non-isolated equilibria
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• THE HEAVY BALL WITH FRICTION METHOD, I. THE CONTINUOUS DYNAMICAL SYSTEM: GLOBAL EXPLORATION OF THE LOCAL MINIMA OF A REAL-VALUED FUNCTION BY ASYMPTOTIC ANALYSIS OF A DISSIPATIVE DYNAMICAL SYSTEM
• Asymptotic for a second-order evolution equation with convex potential andvanishing damping term
• Viscosity Solutions of Minimization Problems
• Asymptotics for a second-order differential equation with nonautonomous damping and an integrable source term
• Proximal Point Algorithm Controlled by a Slowly Vanishing Term: Applications to Hierarchical Minimization
• EXISTENCE AND APPROXIMATION OF SOLUTIONS OF NONLINEAR VARIATIONAL INEQUALITIES
• Weak convergence of the sequence of successive approximations for nonexpansive mappings
• Convex analysis and monotone operator theory in Hilbert spaces
• An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping
• A convergence result for nonautonomous subgradient evolution equations and its application to the steepest descent exponential penalty trajectory in linear programming

This page was built for publication: Combining fast inertial dynamics for convex optimization with Tikhonov regularization