Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity

DOI10.1007/s10107-016-0992-8zbMath1395.34068OpenAlexW2302721240MaRDI QIDQ2413084

Juan Peypouquet, Zaki Chbani, Patrick Redont, Hedy Attouch

Publication date: 6 April 2018

Published in: Mathematical Programming. Series A. Series B (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s10107-016-0992-8

zbMATH Keywords

convex optimizationdynamical systemsvanishing viscositygradient flowsinertial dynamicsNesterov methodfast convergence method

Mathematics Subject Classification ID

Convex programming (90C25) Nonlinear programming (90C30) Nonlinear differential equations in abstract spaces (34G20) Asymptotic properties of solutions to ordinary differential equations (34D05)

Related Items

Fast convergence of inertial dynamics with Hessian-driven damping under geometry assumptions, Fast continuous dynamics inside the graph of subdifferentials of nonsmooth convex functions, A speed restart scheme for a dynamics with Hessian-driven damping, FISTA is an automatic geometrically optimized algorithm for strongly convex functions, No-regret algorithms in on-line learning, games and convex optimization, No-regret dynamics in the Fenchel game: a unified framework for algorithmic convex optimization, Inertial Newton algorithms avoiding strict saddle points, First order inertial optimization algorithms with threshold effects associated with dry friction, Smoothing accelerated proximal gradient method with fast convergence rate for nonsmooth convex optimization beyond differentiability, The heavy ball method regularized by Tikhonov term. Simultaneous convergence of values and trajectories, Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping, Time rescaling of a primal-dual dynamical system with asymptotically vanishing damping, Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian, First-order methods for convex optimization, Fast optimization via inertial dynamics with closed-loop damping, A second order primal-dual dynamical system for a convex-concave bilinear saddle point problem, Lagrangian and Hamiltonian dynamics for probabilities on the statistical bundle, Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES*, Second order splitting dynamics with vanishing damping for additively structured monotone inclusions, Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling, Continuous dynamics related to monotone inclusions and non-smooth optimization problems, Accelerated methods with fastly vanishing subgradients for structured non-smooth minimization, Inducing strong convergence of trajectories in dynamical systems associated to monotone inclusions with composite structure, Asymptotic for a second order evolution equation with damping and regularizing terms, First-order optimization algorithms via inertial systems with Hessian driven damping, First-order inertial algorithms involving dry friction damping, Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics, Inertial accelerated primal-dual methods for linear equality constrained convex optimization problems, Fast inertial dynamic algorithm with smoothing method for nonsmooth convex optimization, Improving “Fast Iterative Shrinkage-Thresholding Algorithm”: Faster, Smarter, and Greedier, Unnamed Item, Generalizing the Optimized Gradient Method for Smooth Convex Minimization, A dynamical system method for solving the split convex feasibility problem, A gradient-type algorithm with backward inertial steps associated to a nonconvex minimization problem, From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective, A new minimizing-movements scheme for curves of maximal slope, Newton-type inertial algorithms for solving monotone equations Governed by sums of potential and nonpotential operators, Accelerated differential inclusion for convex optimization, Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping, On the strong convergence of the trajectories of a Tikhonov regularized second order dynamical system with asymptotically vanishing damping, Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations, Unnamed Item, A second-order accelerated neurodynamic approach for distributed convex optimization, Inertial primal-dual dynamics with damping and scaling for linearly constrained convex optimization problems, Convergence rate of inertial proximal algorithms with general extrapolation and proximal coefficients, On inexact relative-error hybrid proximal extragradient, forward-backward and Tseng's modified forward-backward methods with inertial effects, Unnamed Item, Inertial algorithms for a system of equilibrium problems and fixed point problems, Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3, Second-order flows for computing the ground states of rotating Bose-Einstein condensates, Unnamed Item, Convergence rate of a relaxed inertial proximal algorithm for convex minimization, Convergence rates of the heavy-ball method under the Łojasiewicz property, Fast continuous dynamics inside the graph of maximally monotone operators, Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping, Activity Identification and Local Linear Convergence of Forward--Backward-type Methods, Optimal decay rates for semi-linear non-autonomous evolution equations with vanishing damping, Optimal convergence rates for damped inertial gradient dynamics with flat geometries, The Differential Inclusion Modeling FISTA Algorithm and Optimality of Convergence Rate in the Case b $\leq3$, Inertial projection and contraction algorithms for variational inequalities, On FISTA with a relative error rule, Applying FISTA to optimization problems (with or) without minimizers, Golden ratio algorithms for variational inequalities, Fast convergence of inertial gradient dynamics with multiscale aspects, Convergence Rates of Inertial Forward-Backward Algorithms, Rate of convergence of inertial gradient dynamics with time-dependent viscous damping coefficient, Second-order dynamical systems with penalty terms associated to monotone inclusions, Newton-like Inertial Dynamics and Proximal Algorithms Governed by Maximally Monotone Operators, Inertial forward-backward algorithms with perturbations: application to Tikhonov regularization, Asymptotic for a second-order evolution equation with convex potential andvanishing damping term, Tikhonov regularization of a second order dynamical system with Hessian driven damping, Steklov convexification and a trajectory method for global optimization of multivariate quartic polynomials, Convergence Rates of Damped Inertial Dynamics under Geometric Conditions and Perturbations, Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping, An extension of the second order dynamical system that models Nesterov's convex gradient method, Stochastic optimization with momentum: convergence, fluctuations, and traps avoidance, Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators, Convergence rates for an inertial algorithm of gradient type associated to a smooth non-convex minimization, Unnamed Item, Asymptotic for the perturbed heavy ball system with vanishing damping term, Local and global convergence of a general inertial proximal splitting scheme for minimizing composite functions, Accelerating two projection methods via perturbations with application to intensity-modulated radiation therapy, Convergence rates of an inertial gradient descent algorithm under growth and flatness conditions, Asymptotic analysis of a structure-preserving integrator for damped Hamiltonian systems, A second-order adaptive Douglas-Rachford dynamic method for maximal \(\alpha\)-monotone operators, Optimal Convergence Rates for Nesterov Acceleration, Proximal Gradient Method for Nonsmooth Optimization over the Stiefel Manifold, A second-order dynamical approach with variable damping to nonconvex smooth minimization, On the convergence of a class of inertial dynamical systems with Tikhonov regularization, Continuous Newton-like inertial dynamics for monotone inclusions, Relative-error inertial-relaxed inexact versions of Douglas-Rachford and ADMM splitting algorithms, Steklov regularization and trajectory methods for univariate global optimization, Convergence Rates of Inertial Primal-Dual Dynamical Methods for Separable Convex Optimization Problems, Second order asymptotical regularization methods for inverse problems in partial differential equations, Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics, Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution, A piecewise conservative method for unconstrained convex optimization, Generalized Nesterov's accelerated proximal gradient algorithms with convergence rate of order \(o(1/k^2)\), A new class of accelerated regularization methods, with application to bioluminescence tomography, Convergence rates of first- and higher-order dynamics for solving linear ill-posed problems, Understanding the acceleration phenomenon via high-resolution differential equations, From differential equation solvers to accelerated first-order methods for convex optimization, A control-theoretic perspective on optimal high-order optimization, Convergence rates for the heavy-ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition, Accelerated Iterative Regularization via Dual Diagonal Descent, Convergence rates of damped inerial dynamics from multi-degree-of-freedom system, Convergence of a relaxed inertial forward-backward algorithm for structured monotone inclusions, Two structure-preserving time discretizations for gradient flows, Fast primal-dual algorithm via dynamical system for a linearly constrained convex optimization problem, Time-varying continuous-time optimisation with pre-defined finite-time stability, A Class of Second-Order Geometric Quasilinear Hyperbolic PDEs and Their Application in Imaging, Tikhonov Regularization of a Perturbed Heavy Ball System with Vanishing Damping, A primal-dual flow for affine constrained convex optimization, Fast convex optimization via a third-order in time evolution equation, On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping, Self-Adaptive Inertial Projection and Contraction Algorithm for Monotone Variational Inequality, A fast continuous time approach with time scaling for nonsmooth convex optimization, Proximal Gradient Methods for Machine Learning and Imaging

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Smooth minimization of non-smooth functions
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Optimized first-order methods for smooth convex minimization
• A unified approach to the asymptotic almost-equivalence of evolution systems without Lipschitz conditions
• An inertial forward-backward algorithm for monotone inclusions
• Asymptotic almost-equivalence of Lipschitz evolution systems in Banach spaces
• Asymptotic convergence of nonlinear contraction semigroups in Hilbert space
• Quelques propriétés des opérateurs angle-bornes et n-cycliquement monotones
• Un exemple concernant le comportement asymptotique de la solution du problème \(du/dt+\partial\varphi(\mu)\ni=0\)
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• Introductory lectures on convex optimization. A basic course.
• Convergence of a splitting inertial proximal method for monotone operators
• Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces
• The Remarkable Effectiveness of Time-Dependent Damping Terms for Second Order Evolution Equations
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• Accelerated and Inexact Forward-Backward Algorithms
• Convex Optimization in Normed Spaces
• Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time
• Variational Analysis in Sobolev andBVSpaces
• Stability of Over-Relaxations for the Forward-Backward Algorithm, Application to FISTA
• On the Long Time Behavior of Second Order Differential Equations with Asymptotically Small Dissipation
• On the long time behavior of second order differential equations with asymptotically small dissipation
• New Proximal Point Algorithms for Convex Minimization
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• A Dynamical Approach to an Inertial Forward-Backward Algorithm for Convex Minimization
• Weak convergence of the sequence of successive approximations for nonexpansive mappings
• Convex analysis and monotone operator theory in Hilbert spaces
• An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping