A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.

DOI10.1016/S0021-7824(01)01253-3zbMath1036.34072MaRDI QIDQ1406910

Patrick Redont, Jérôme Bolte, Felipe Alvarez, Hedy Attouch

Publication date: 7 September 2003

Published in: Journal de Mathématiques Pures et Appliquées. Neuvième Série (Search for Journal in Brave)

zbMATH Keywords

optimal control dissipative dynamical systems asymptotic behaviour continuous Newton method gradient-like dynamical systems gradient-projection methods second-order in time dynamical system shocks in mechanics

Mathematics Subject Classification ID

Nonlinear programming (90C30) Nonlinear differential equations in abstract spaces (34G20) Control problems involving ordinary differential equations (34H05) Problems involving a system of particles with friction (70F40) Special approximation methods (nonlinear Galerkin, etc.) for infinite-dimensional dissipative dynamical systems (37L65)

Related Items

Fast convex optimization via inertial dynamics combining viscous and Hessian-driven damping with time rescaling, Continuous dynamics related to monotone inclusions and non-smooth optimization problems, Accelerated methods with fastly vanishing subgradients for structured non-smooth minimization, Inducing strong convergence of trajectories in dynamical systems associated to monotone inclusions with composite structure, First-order optimization algorithms via inertial systems with Hessian driven damping, Asymptotic behavior of second-order dissipative evolution equations combining potential with non-potential effects, Asymptotic behavior of Newton-like inertial dynamics involving the sum of potential and nonpotential terms, Fast convergence of dynamical ADMM via time scaling of damped inertial dynamics, The rate of convergence of optimization algorithms obtained via discretizations of heavy ball dynamical systems for convex optimization problems, A new inertial-type hybrid projection-proximal algorithm for monotone inclusions, Fast convex optimization via inertial dynamics with Hessian driven damping, A forward-backward dynamical approach to the minimization of the sum of a nonsmooth convex with a smooth nonconvex function, Implicit and adaptive inverse preconditioned gradient methods for nonlinear problems, Approaching nonsmooth nonconvex optimization problems through first order dynamical systems with hidden acceleration and Hessian driven damping terms, Sparse approximations of matrix functions via numerical integration of ODEs, Inertial Game Dynamics and Applications to Constrained Optimization, Unnamed Item, Global convergence of a closed-loop regularized Newton method for solving monotone inclusions in Hilbert spaces, A dynamical regularization algorithm for solving inverse source problems of elliptic partial differential equations, A forward-backward dynamical approach for nonsmooth problems with block structure coupled by a smooth function, Combining fast inertial dynamics for convex optimization with Tikhonov regularization, Convergence rates for forward-backward dynamical systems associated with strongly monotone inclusions, Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity, First-order frameworks for continuous Newton-like dynamics governed by maximally monotone operators, From the Ravine Method to the Nesterov Method and Vice Versa: A Dynamical System Perspective, A new minimizing-movements scheme for curves of maximal slope, Newton-type inertial algorithms for solving monotone equations Governed by sums of potential and nonpotential operators, Convergence of iterates for first-order optimization algorithms with inertia and Hessian driven damping, Accelerated dynamics with dry friction via time scaling and averaging of doubly nonlinear evolution equations, Unnamed Item, Fast convergence of inertial dynamics with Hessian-driven damping under geometry assumptions, Fast continuous dynamics inside the graph of subdifferentials of nonsmooth convex functions, Convergence rate of inertial proximal algorithms with general extrapolation and proximal coefficients, Locating Theorems of Differential Inclusions Governed by Maximally Monotone Operators, Practical perspectives on symplectic accelerated optimization, Unnamed Item, On the second-order asymptotical regularization of linear ill-posed inverse problems, Unnamed Item, Asymptotic behavior of an adapted implicit discretization of slowly damped second order dynamical systems, Inertial Newton algorithms avoiding strict saddle points, First order inertial optimization algorithms with threshold effects associated with dry friction, Convergence of inertial dynamics driven by sums of potential and nonpotential operators with implicit Newton-like damping, Time rescaling of a primal-dual dynamical system with asymptotically vanishing damping, Fast continuous dynamics inside the graph of maximally monotone operators, Fast optimization via inertial dynamics with closed-loop damping, Every ordinary differential equation with a strict Lyapunov function is a gradient system, Continuous Newton-like Methods Featuring Inertia and Variable Mass, Fast convex optimization via a third-order in time evolution equation: TOGES-V an improved version of TOGES*, On the Convergence of Gradient-Like Flows with Noisy Gradient Input, Second order splitting dynamics with vanishing damping for additively structured monotone inclusions, Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping, Second-order dynamical systems with penalty terms associated to monotone inclusions, Evolution differential inclusion with projection for solving constrained nonsmooth convex optimization in Hilbert space, Long time behaviour and stationary regime of memory gradient diffusions, Convergence of analytic gradient-type systems with periodicity and its applications in Kuramoto models, Newton-like Inertial Dynamics and Proximal Algorithms Governed by Maximally Monotone Operators, Tikhonov regularization of a second order dynamical system with Hessian driven damping, Improved convergence rates and trajectory convergence for primal-dual dynamical systems with vanishing damping, An extension of the second order dynamical system that models Nesterov's convex gradient method, AUV based source seeking with estimated gradients, Damped Arrow-Hurwicz algorithm for sphere packing, Second-Order Dynamics with Hessian-Driven Damping for Linearly Constrained Convex Minimization, Approaching nonsmooth nonconvex minimization through second-order proximal-gradient dynamical systems, Weak versus strong convergence of a regularized Newton dynamic for maximal monotone operators, Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces, A primal-dual dynamical approach to structured convex minimization problems, On the Łojasiewicz exponent of Kuramoto model, Principal Subspace Flows Via Mechanical Systems on Grassmann Manifolds, Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity, A Dynamical Approach to Constrained Nonsmooth Convex Minimization Problem Coupling with Penalty Function Method in Hilbert Space, A second-order dynamical approach with variable damping to nonconvex smooth minimization, Second Order Forward-Backward Dynamical Systems For Monotone Inclusion Problems, Continuous Newton-like inertial dynamics for monotone inclusions, A second-order dynamical system with Hessian-driven damping and penalty term associated to variational inequalities, APPLICATIONS OF THE ŁOJASIEWICZ–SIMON, GRADIENT INEQUALITY TO GRADIENT-LIKE EVOLUTION EQUATIONS, Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics, An Inertial Newton Algorithm for Deep Learning, Fixed point iterations coupled with relaxation factors and inertial effects, Understanding the acceleration phenomenon via high-resolution differential equations, A control-theoretic perspective on optimal high-order optimization, Convergence rates for the heavy-ball continuous dynamics for non-convex optimization, under Polyak-Łojasiewicz condition, Convergence rates of damped inerial dynamics from multi-degree-of-freedom system, A Class of Second-Order Geometric Quasilinear Hyperbolic PDEs and Their Application in Imaging, Differential equations and solution of linear systems, Fast convex optimization via a third-order in time evolution equation, On the effect of perturbations in first-order optimization methods with inertia and Hessian driven damping, A fast continuous time approach with time scaling for nonsmooth convex optimization, Generating Nesterov's accelerated gradient algorithm by using optimal control theory for optimization, Second-order dynamical systems associated to variational inequalities

Cites Work