Newton-like Inertial Dynamics and Proximal Algorithms Governed by Maximally Monotone Operators

DOI10.1137/20M1333316zbMath1477.90058OpenAlexW3085330744MaRDI QIDQ5139837

Hedy Attouch, Szilárd Csaba László

Publication date: 11 December 2020

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/20m1333316

zbMATH Keywords

Newton methodvanishing viscosityLyapunov analysismaximally monotone operatorsYosida regularizationdamped inertial dynamicstime-dependent viscosityHessian dampinglarge step proximal method

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25) Iterative procedures involving nonlinear operators (47J25) Programming in abstract spaces (90C48) Dynamical systems in optimization and economics (37N40)

Related Items

Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling ⋮ Accelerated proximal algorithms with a correction term for monotone inclusions ⋮ Asymptotic behavior of Newton-like inertial dynamics involving the sum of potential and nonpotential terms ⋮ First-order frameworks for continuous Newton-like dynamics governed by maximally monotone operators ⋮ From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective ⋮ Newton-type inertial algorithms for solving monotone equations Governed by sums of potential and nonpotential operators ⋮ Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping ⋮ Accelerated smoothing hard thresholding algorithms for \(\ell_0\) regularized nonsmooth convex regression problem ⋮ Inertial Newton algorithms avoiding strict saddle points ⋮ Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping ⋮ Fast optimization via inertial dynamics with closed-loop damping ⋮ Continuous Newton-like Methods Featuring Inertia and Variable Mass ⋮ Second order splitting dynamics with vanishing damping for additively structured monotone inclusions ⋮ Fast convergence of generalized forward-backward algorithms for structured monotone inclusions ⋮ Continuous Newton-like inertial dynamics for monotone inclusions ⋮ A control-theoretic perspective on optimal high-order optimization ⋮ Tikhonov Regularization of a Perturbed Heavy Ball System with Vanishing Damping ⋮ On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping

Cites Work

• Unnamed Item
• Fast convex optimization via inertial dynamics with Hessian driven damping
• Global convergence of a closed-loop regularized Newton method for solving monotone inclusions in Hilbert spaces
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• An inertial forward-backward algorithm for monotone inclusions
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• Monotone operator theory in convex optimization
• Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators
• Convergence of a splitting inertial proximal method for monotone operators
• First-order optimization algorithms via inertial systems with Hessian driven damping
• Convergence of a relaxed inertial proximal algorithm for maximally monotone operators
• Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces
• Convergence rate of inertial forward-backward algorithm beyond Nesterov's rule
• Convergence of a relaxed inertial forward-backward algorithm for structured monotone inclusions
• Shadow Douglas-Rachford splitting for monotone inclusions
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• Second Order Forward-Backward Dynamical Systems For Monotone Inclusion Problems
• A dynamic approach to a proximal-Newton method for monotone inclusions in Hilbert spaces, with complexity O(1/n^2)
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• A Continuous Dynamical Newton-Like Approach to Solving Monotone Inclusions
• Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time
• Asymptotic behavior of second-order dissipative evolution equations combining potential with non-potential effects
• Monotone Operators and the Proximal Point Algorithm
• Quasi-Nonexpansive Iterations on the Affine Hull of Orbits: From Mann's Mean Value Algorithm to Inertial Methods
• Convergence Rates of Inertial Forward-Backward Algorithms
• A generic online acceleration scheme for optimization algorithms via relaxation and inertia
• Asymptotic for a second-order evolution equation with convex potential andvanishing damping term
• Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
• Proximal Activation of Smooth Functions in Splitting Algorithms for Convex Image Recovery
• A Forward-Backward Splitting Method for Monotone Inclusions Without Cocoercivity
• Convex analysis and monotone operator theory in Hilbert spaces
• An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping