Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators

DOI10.1007/s10107-018-1252-xzbMath1412.37083arXiv1705.03803OpenAlexW2963505547WikidataQ130157636 ScholiaQ130157636MaRDI QIDQ1739043

Hedy Attouch, Juan Peypouquet

Publication date: 24 April 2019

Published in: Mathematical Programming. Series A. Series B (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1705.03803

zbMATH Keywords

asymptotic stabilizationvanishing viscosityLyapunov analysisYosida regularizationdamped inertial dynamicstime-dependent viscosity

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Convex programming (90C25) Numerical optimization and variational techniques (65K10) Management decision making, including multiple objectives (90B50) Applications of functional analysis in optimization, convex analysis, mathematical programming, economics (46N10) Dynamical systems in optimization and economics (37N40)

Related Items

Continuous dynamics related to monotone inclusions and non-smooth optimization problems ⋮ Accelerated proximal algorithms with a correction term for monotone inclusions ⋮ Asymptotic behavior of Newton-like inertial dynamics involving the sum of potential and nonpotential terms ⋮ Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics ⋮ Convergence of proximal solutions for evolution inclusions with time-dependent maximal monotone operators ⋮ First-order frameworks for continuous Newton-like dynamics governed by maximally monotone operators ⋮ Newton-type inertial algorithms for solving monotone equations Governed by sums of potential and nonpotential operators ⋮ On the strong convergence of the trajectories of a Tikhonov regularized second order dynamical system with asymptotically vanishing damping ⋮ On the strong convergence of continuous Newton-like inertial dynamics with Tikhonov regularization for monotone inclusions ⋮ Fast continuous dynamics inside the graph of subdifferentials of nonsmooth convex functions ⋮ A speed restart scheme for a dynamics with Hessian-driven damping ⋮ Unnamed Item ⋮ Convergence rate of a relaxed inertial proximal algorithm for convex minimization ⋮ A fast continuous time approach for non-smooth convex optimization using Tikhonov regularization technique ⋮ Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping ⋮ Fast continuous dynamics inside the graph of maximally monotone operators ⋮ Fast optimization via inertial dynamics with closed-loop damping ⋮ From Halpern's fixed-point iterations to Nesterov's accelerated interpretations for root-finding problems ⋮ Inertial proximal point algorithms for solving a class of split feasibility problems ⋮ Second order splitting dynamics with vanishing damping for additively structured monotone inclusions ⋮ Convergence of a relaxed inertial proximal algorithm for maximally monotone operators ⋮ Unnamed Item ⋮ Unnamed Item ⋮ Newton-like Inertial Dynamics and Proximal Algorithms Governed by Maximally Monotone Operators ⋮ Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping ⋮ Accelerated proximal point method for maximally monotone operators ⋮ Games and cost of change ⋮ Conditions for the existence, identification and calculus rules of the threshold of prox-boundedness ⋮ Fast convergence of generalized forward-backward algorithms for structured monotone inclusions ⋮ Unnamed Item ⋮ Continuous Newton-like inertial dynamics for monotone inclusions ⋮ Dynamical Systems Coupled with Monotone Set-Valued Operators: Formalisms, Applications, Well-Posedness, and Stability ⋮ A Dynamical Approach to Two-Block Separable Convex Optimization Problems with Linear Constraints ⋮ Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics ⋮ Stochastic relaxed inertial forward-backward-forward splitting for monotone inclusions in Hilbert spaces ⋮ Generalized Nesterov's accelerated proximal gradient algorithms with convergence rate of order \(o(1/k^2)\) ⋮ An accelerated differential equation system for generalized equations ⋮ Convergence of a relaxed inertial forward-backward algorithm for structured monotone inclusions ⋮ Tikhonov Regularization of a Perturbed Heavy Ball System with Vanishing Damping ⋮ Multiply Accelerated Value Iteration for NonSymmetric Affine Fixed Point Problems and Application to Markov Decision Processes ⋮ A fast continuous time approach with time scaling for nonsmooth convex optimization ⋮ Iterative regularization for constrained minimization formulations of nonlinear inverse problems

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Optimized first-order methods for smooth convex minimization
• Fast convex optimization via inertial dynamics with Hessian driven damping
• On the convergence of the iterates of the ``fast iterative shrinkage/thresholding algorithm
• Functional analysis, Sobolev spaces and partial differential equations
• Introductory lectures on convex optimization. A basic course.
• From error bounds to the complexity of first-order descent methods for convex functions
• Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• The Rate of Convergence of Nesterov's Accelerated Forward-Backward Method is Actually Faster Than $1/k^2$
• A Differential Equation for Modeling Nesterov's Accelerated Gradient Method: Theory and Insights
• Accelerated and Inexact Forward-Backward Algorithms
• Convex Optimization in Normed Spaces
• Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time
• Asymptotic behavior of second-order dissipative evolution equations combining potential with non-potential effects
• On the long time behavior of second order differential equations with asymptotically small dissipation
• Quantitative Stability of Variational Systems: I. The Epigraphical Distance
• Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming
• Variational Analysis
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• Convergence Rates of Inertial Forward-Backward Algorithms
• Asymptotic for a second-order evolution equation with convex potential andvanishing damping term
• Asymptotics for a second-order differential equation with nonautonomous damping and an integrable source term
• Quantitative Stability of Variational Systems II. A Framework for Nonlinear Conditioning
• Weak convergence of the sequence of successive approximations for nonexpansive mappings
• A Stochastic Approximation Method
• Convex analysis and monotone operator theory in Hilbert spaces
• An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping