Continuous dynamics related to monotone inclusions and non-smooth optimization problems

DOI10.1007/S11228-020-00548-YzbMATH Open1471.34123arXiv2007.00460OpenAlexW3043520642MaRDI QIDQ829490FDOQ829490

Authors: Ernö Robert Csetnek 

Publication date: 6 May 2021

Published in: Set-Valued and Variational Analysis (Search for Journal in Brave)

Abstract: The aim of this survey is to present the main important techniques and tools from variational analysis used for first and second order dynamical systems of implicit type for solving monotone inclusions and non-smooth optimization problems. The differential equations are expressed by means of the resolvent (in case of a maximally monotone set valued operator) or the proximal operator for non-smooth functions. The asymptotic analysis of the trajectories generated relies on Lyapunov theory, where the appropriate energy functional plays a decisive role. While the most part of the paper is related to monotone inclusions and convex optimization problems in the variational case, we present also results for dynamical systems for solving non-convex optimization problems, where the Kurdyka-Lojasiewicz property is used.

Full work available at URL: https://arxiv.org/abs/2007.00460

Recommendations

• Newton-like dynamics associated to nonconvex optimization problems
• Approaching nonsmooth nonconvex optimization problems through first order dynamical systems with hidden acceleration and Hessian driven damping terms
• Variable metric backward-forward dynamical systems for monotone inclusion problems
• Inducing strong convergence of trajectories in dynamical systems associated to monotone inclusions with composite structure
• On the dynamics of a differential inclusion built upon a nonconvex constrained minimization problem

zbMATH Keywords

forward-backward algorithmdynamical systemsresolventproximal operator[https://portal.mardi4nfdi.de/w/index.php?title=+Special%3ASearch&search=Krasnosel%27ski%EF%BF%BD%EF%BF%BD-Mann+algorithm&go=Go Krasnosel'ski��-Mann algorithm]monotone inclusions[https://portal.mardi4nfdi.de/w/index.php?title=+Special%3ASearch&search=Kurdyka-%EF%BF%BD%EF%BF%BDojasiewicz+property&go=Go Kurdyka-��ojasiewicz property]Lyapunov analysisnon-smooth optimization problem

Mathematics Subject Classification ID

Nonconvex programming, global optimization (90C26) Asymptotic properties of solutions to ordinary differential equations (34D05) Monotone operators and generalizations (47H05) Iterative procedures involving nonlinear operators (47J25) Programming in abstract spaces (90C48) Research exposition (monographs, survey articles) pertaining to ordinary differential equations (34-02) Evolution inclusions (34G25)

Cites Work

• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• iPiano: inertial proximal algorithm for nonconvex optimization
• Variational Analysis
• Convex analysis and monotone operator theory in Hilbert spaces
• Introductory lectures on convex optimization. A basic course.
• Hankel matrix rank minimization with applications to system identification and realization
• Title not available (Why is that?)
• Applications of a Splitting Algorithm to Decomposition in Convex Programming and Variational Inequalities
• Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Łojasiewicz Inequality
• Proximal alternating linearized minimization for nonconvex and nonsmooth problems
• A proximal-based deomposition method for compositions method for convex minimization problems
• A first-order primal-dual algorithm for convex problems with applications to imaging
• Title not available (Why is that?)
• Clarke Subgradients of Stratifiable Functions
• Title not available (Why is that?)
• Monotone Operators and the Proximal Point Algorithm
• Title not available (Why is that?)
• Title not available (Why is that?)
• Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
• A splitting algorithm for dual monotone inclusions involving cocoercive operators
• On the convergence rate improvement of a primal-dual splitting algorithm for solving monotone inclusion problems
• From Hahn--Banach to monotonicity
• On the maximal monotonicity of subdifferential mappings
• An inertial forward-backward algorithm for the minimization of the sum of two nonconvex functions
• Convex functions. Constructions, characterizations and counterexamples
• A primal-dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms
• On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
• Primal-dual splitting algorithm for solving inclusions with mixtures of composite, Lipschitzian, and parallel-sum type monotone operators
• A Modified Forward-Backward Splitting Method for Maximal Monotone Mappings
• A Primal-Dual Splitting Algorithm for Finding Zeros of Sums of Maximal Monotone Operators
• Asymptotics for a class of non-linear evolution equations, with applications to geometric problems
• On gradients of functions definable in o-minimal structures
• The Łojasiewicz Inequality for Nonsmooth Subanalytic Functions with Applications to Subgradient Dynamical Systems
• Characterizations of Łojasiewicz inequalities: Subgradient flows, talweg, convexity
• On the convergence of the proximal algorithm for nonsmooth functions involving analytic features
• A Forward-Backward Splitting Method for Monotone Inclusions Without Cocoercivity
• Rate of Convergence Analysis of Decomposition Methods Based on the Proximal Method of Multipliers for Convex Minimization
• Convergence Rate Analysis of Several Splitting Schemes
• A differential equation for modeling Nesterov's accelerated gradient method: theory and insights
• Convergence rates with inexact non-expansive operators
• THE HEAVY BALL WITH FRICTION METHOD, I. THE CONTINUOUS DYNAMICAL SYSTEM: GLOBAL EXPLORATION OF THE LOCAL MINIMA OF A REAL-VALUED FUNCTION BY ASYMPTOTIC ANALYSIS OF A DISSIPATIVE DYNAMICAL SYSTEM
• NON-STRICTLY CONVEX MINIMIZATION OVER THE FIXED POINT SET OF AN ASYMPTOTICALLY SHRINKING NONEXPANSIVE MAPPING
• Asymptotic convergence of nonlinear contraction semigroups in Hilbert space
• A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
• Fast convex optimization via inertial dynamics with Hessian driven damping
• A continuous dynamical Newton-like approach to solving monotone inclusions
• Asymptotic behavior of coupled dynamical systems with multiscale aspects
• Evolution equations for maximal monotone operators: asymptotic analysis in continuous and discrete time
• Title not available (Why is that?)
• Continuous gradient projection method in Hilbert spaces
• Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• Dynamical systems and forward–backward algorithms associated with the sum of a convex subdifferential and a monotone cocoercive operator
• Title not available (Why is that?)
• A dynamical system associated with the fixed points set of a nonexpansive operator
• A Generalized Proximal Point Algorithm and Its Convergence Rate
• Convergence of solutions to second-order gradient-like systems with analytic nonlinearities
• Title not available (Why is that?)
• A dynamic approach to a proximal-Newton method for monotone inclusions in Hilbert spaces, with complexity \(\mathcal{O}(1/n^2)\)
• The forward-backward-forward method from continuous and discrete perspective for pseudo-monotone variational inequalities in Hilbert spaces
• Convergence of inertial dynamics and proximal algorithms governed by maximally monotone operators
• Approaching nonsmooth nonconvex minimization through second-order proximal-gradient dynamical systems
• A primal-dual dynamical approach to structured convex minimization problems
• Backward-forward-reflected-backward splitting for three operator monotone inclusions
• Fixing and extending some recent results on the ADMM algorithm
• The proximal alternating minimization algorithm for two-block separable convex optimization problems with linear constraints
• Convergence of a relaxed inertial forward-backward algorithm for structured monotone inclusions
• Shadow Douglas-Rachford splitting for monotone inclusions
• Combining fast inertial dynamics for convex optimization with Tikhonov regularization
• Convergence rates for forward-backward dynamical systems associated with strongly monotone inclusions
• ADMM for monotone operators: convergence analysis and rates
• Second order forward-backward dynamical systems for monotone inclusion problems
• Asymptotic behavior of second-order dissipative evolution equations combining potential with non-potential effects
• A forward-backward dynamical approach to the minimization of the sum of a nonsmooth convex with a smooth nonconvex function
• Quasi-Nonexpansive Iterations on the Affine Hull of Orbits: From Mann's Mean Value Algorithm to Inertial Methods
• A forward-backward-forward differential equation and its asymptotic properties
• Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3

Cited In (13)

• On the convergence of a class of inertial dynamical systems with Tikhonov regularization
• Locating Theorems of Differential Inclusions Governed by Maximally Monotone Operators
• A Dynamical Approach to Two-Block Separable Convex Optimization Problems with Linear Constraints
• Title not available (Why is that?)
• A second-order adaptive Douglas-Rachford dynamic method for maximal \(\alpha\)-monotone operators
• On the first- and second-order strongly monotone dynamical systems and minimization problems
• Forward-backward-half forward dynamical systems for monotone inclusion problems with application to v-GNE
• First-order frameworks for continuous Newton-like dynamics governed by maximally monotone operators
• Finite-time nonconvex optimization using time-varying dynamical systems
• Distributed \(k\)-winners-take-all via multiple neural networks with inertia
• Fast continuous dynamics inside the graph of maximally monotone operators
• On the dynamics of a differential inclusion built upon a nonconvex constrained minimization problem
• On a discrete-time non-zero-sum Dynkin problem with monotonicity

Uses Software

• iPiano

This page was built for publication: Continuous dynamics related to monotone inclusions and non-smooth optimization problems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q829490)