The Differential Inclusion Modeling FISTA Algorithm and Optimality of Convergence Rate in the Case b $\leq3$

DOI10.1137/17M1128642zbMath1408.34024OpenAlexW2793617906MaRDI QIDQ4606662

Dossal Charles, Aujol Jean-François, Apidopoulos Vassilis

Publication date: 9 March 2018

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/17m1128642

zbMATH Keywords

convex optimizationasymptotic behaviordifferential inclusionoptimalityFISTA algorithmfast minimization

Mathematics Subject Classification ID

Ordinary differential inclusions (34A60) Soliton theory, asymptotic behavior of solutions of infinite-dimensional Hamiltonian systems (37K40) Optimality conditions for problems involving relations other than differential equations (49K21)

Related Items

Convergence Rates of the Heavy Ball Method for Quasi-strongly Convex Optimization, From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective, Accelerated differential inclusion for convex optimization, Inertial primal-dual dynamics with damping and scaling for linearly constrained convex optimization problems, Fast continuous dynamics inside the graph of subdifferentials of nonsmooth convex functions, Inertial Newton algorithms avoiding strict saddle points, Convergence rates of the heavy-ball method under the Łojasiewicz property, Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping, Accelerated gradient methods combining Tikhonov regularization with geometric damping driven by the Hessian, Optimal decay rates for semi-linear non-autonomous evolution equations with vanishing damping, Optimal convergence rates for damped inertial gradient dynamics with flat geometries, Rate of convergence of inertial gradient dynamics with time-dependent viscous damping coefficient, Rayleigh quotient minimization for absolutely one-homogeneous functionals, Convergence rates of an inertial gradient descent algorithm under growth and flatness conditions, Theoretical Analysis of Flows Estimating Eigenfunctions of One-Homogeneous Functionals, Optimal Convergence Rates for Nesterov Acceleration, Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule, Convergence Rates of Inertial Primal-Dual Dynamical Methods for Separable Convex Optimization Problems, Damped inertial dynamics with vanishing Tikhonov regularization: strong asymptotic convergence towards the minimum norm solution, Convergence rates of first- and higher-order dynamics for solving linear ill-posed problems, Understanding the acceleration phenomenon via high-resolution differential equations, From differential equation solvers to accelerated first-order methods for convex optimization, A control-theoretic perspective on optimal high-order optimization, Convergence rates for the heavy-ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition, Accelerated Iterative Regularization via Dual Diagonal Descent

Cites Work

• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• Asymptotics for some vibro-impact problems with a linear dissipation term
• Introductory lectures on convex optimization. A basic course.
• Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• Functional Analysis, Calculus of Variations and Optimal Control
• Stability of Over-Relaxations for the Forward-Backward Algorithm, Application to FISTA
• On the Long Time Behavior of Second Order Differential Equations with Asymptotically Small Dissipation
• On the long time behavior of second order differential equations with asymptotically small dissipation
• New Proximal Point Algorithms for Convex Minimization
• A class of nonlinear differential equations of second order in time
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• THE HEAVY BALL WITH FRICTION METHOD, I. THE CONTINUOUS DYNAMICAL SYSTEM: GLOBAL EXPLORATION OF THE LOCAL MINIMA OF A REAL-VALUED FUNCTION BY ASYMPTOTIC ANALYSIS OF A DISSIPATIVE DYNAMICAL SYSTEM
• AN EXISTENCE RESULT FOR VIBRATIONS WITH UNILATERAL CONSTRAINTS
• Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
• Asymptotics for a second-order differential equation with nonautonomous damping and an integrable source term
• Weak convergence of the sequence of successive approximations for nonexpansive mappings
• Convex analysis and monotone operator theory in Hilbert spaces
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item