A control-theoretic perspective on optimal high-order optimization
type: Item
instance of: scholarly article
title: A control-theoretic perspective on optimal high-order optimization
zbMATH Open document ID: 1506.90205
author: Michael Jordan
author: Tian-Yi Lin
published in: Mathematical Programming. Series A. Series B
publication date: 2022-10-24T00:00:00Z
full work available at URL: https://arxiv.org/abs/1912.07168
Mathematics Subject Classification ID: 90C25
Mathematics Subject Classification ID: 90C60
Mathematics Subject Classification ID: 49M37
Mathematics Subject Classification ID: 68Q25
zbMATH DE Number: 7606034
zbMATH Keywords: convex optimization
zbMATH Keywords: optimal acceleration
zbMATH Keywords: closed-loop control system
zbMATH Keywords: feedback control
zbMATH Keywords: high-order tensor algorithm
zbMATH Keywords: iteration complexity
MaRDI profile type: MaRDI publication profile
OpenAlex ID: W3208977561
arXiv ID: 1912.07168
cites work: Newton-like dynamics and forward-backward methods for structured monotone inclusions in Hilbert spaces
cites work: Finite Convergence of Proximal-Gradient Inertial Algorithms Combining Dry Friction with Hessian-Driven Damping
cites work: On the Minimizing Property of a Second Order Dissipative System in Hilbert Spaces
cites work: An inertial proximal method for maximal monotone operators via discretization of a nonlinear oscillator with damping
cites work: A second-order gradient-like dissipative dynamical system with Hessian-driven damping. Application to optimization and mechanics.
cites work: A dynamical system associated with Newton's method for parametric approximations of convex minimization problems
cites work: Q4889631
cites work: Oracle complexity of second-order methods for smooth convex optimization
cites work: A dynamic approach to a proximal-Newton method for monotone inclusions in Hilbert spaces, with complexity \(\mathcal{O}(1/n^2)\)
cites work: Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
cites work: Convergence of damped inertial dynamics governed by regularized maximally monotone operators
cites work: Convergence of a relaxed inertial proximal algorithm for maximally monotone operators
cites work: Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
cites work: Fast Proximal Methods via Time Scaling of Damped Inertial Dynamics
cites work: Rate of convergence of the Nesterov accelerated gradient method in the subcritical case α ≤ 3
cites work: A dynamical approach to convex minimization coupling approximation with the steepest descent method
cites work: THE HEAVY BALL WITH FRICTION METHOD, I. THE CONTINUOUS DYNAMICAL SYSTEM: GLOBAL EXPLORATION OF THE LOCAL MINIMA OF A REAL-VALUED FUNCTION BY ASYMPTOTIC ANALYSIS OF A DISSIPATIVE DYNAMICAL SYSTEM
cites work: Newton-like Inertial Dynamics and Proximal Algorithms Governed by Maximally Monotone Operators
cites work: A second-order differential system with Hessian-driven damping; application to non-elastic shock laws
cites work: The rate of convergence of Nesterov's accelerated forward-backward method is actually faster than \(1/k^2\)
cites work: Fast convex optimization via inertial dynamics with Hessian driven damping
cites work: The second-order in time continuous Newton method
cites work: Global convergence of a closed-loop regularized Newton method for solving monotone inclusions in Hilbert spaces
cites work: A Continuous Dynamical Newton-Like Approach to Solving Monotone Inclusions
cites work: Every ordinary differential equation with a strict Lyapunov function is a gradient system
cites work: Convergence to equilibrium for solutions of an abstract wave equation with general damping function
cites work: A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
cites work: On damped second-order gradient systems
cites work: A generalization of a lemma of bellman and its application to uniqueness problems of differential equations
cites work: Evaluation complexity for nonlinear constrained optimization using unscaled KKT conditions and high-order models
cites work: Worst-case evaluation complexity for unconstrained nonlinear optimization using high-order regularized models
cites work: Characterizations of Łojasiewicz inequalities: Subgradient flows, talweg, convexity
cites work: Second order forward-backward dynamical systems for monotone inclusion problems
cites work: Universal Regularization Methods: Varying the Power, the Smoothness and the Accuracy
cites work: Second-order optimality and beyond: characterization and evaluation complexity in convexly constrained nonlinear optimization
cites work: Convergence of global and bounded solutions of a second order gradient like system with nonlinear dissipation and analytic nonlinearity
cites work: Q5848416
cites work: The Approximate Duality Gap Technique: A Unified Theory of First-Order Methods
cites work: Analysis of Optimization Algorithms via Integral Quadratic Constraints: Nonstrongly Convex Problems
cites work: On dissipative symplectic integration with applications to gradient-based optimization
cites work: Conformal symplectic and relativistic optimization
cites work: Q4421936
cites work: Regularized Newton Methods for Minimizing Functions with Hölder Continuous Hessians
cites work: Accelerated Regularized Newton Methods for Minimizing Composite Convex Functions
cites work: Tensor Methods for Minimizing Convex Functions with Hölder Continuous Higher-Order Derivatives
cites work: New Proximal Point Algorithms for Convex Minimization
cites work: Q5472799
cites work: A Unified Adaptive Tensor Approximation Scheme to Accelerate Composite Convex Optimization
cites work: Near-Optimal Hyperfast Second-Order Method for Convex Optimization
cites work: On gradients of functions definable in o-minimal structures
cites work: Uniqueness theorems and successive approximations
cites work: Analysis and Design of Optimization Algorithms via Integral Quadratic Constraints
cites work: First-order continuous Newton-like systems for monotone inclusions
cites work: Q5618030
cites work: Q5633161
cites work: On High-order Model Regularization for Constrained Optimization
cites work: Asymptotic for a second-order evolution equation with convex potential andvanishing damping term

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: On the Complexity of the Hybrid Proximal Extragradient Method for the Iterates and the Ergodic Mean

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: An accelerated hybrid proximal extragradient method for convex optimization and its implications to second-order methods

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Q4998976

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Accelerating the cubic regularization of Newton's method on convex problems

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Gradient methods for minimizing composite functions

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Lectures on convex optimization

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Q3491338

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Monotone Operators and the Proximal Point Algorithm

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Convergence Rates of Damped Inertial Dynamics under Geometric Conditions and Perturbations

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: A hybrid approximate extragradient-proximal point algorithm using the enlargement of a maximal monotone operator

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Unified Acceleration of High-Order Algorithms under General Hölder Continuity

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: A differential equation for modeling Nesterov's accelerated gradient method: theory and insights

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Q5322904

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Approximation accuracy, gradient methods, and error bound for structured convex optimization

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: The Differential Inclusion Modeling FISTA Algorithm and Optimality of Convergence Rate in the Case b $\leq3$

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: A variational perspective on accelerated methods in optimization

A control-theoretic perspective on optimal high-order optimization (cites work)
cites work: Q4999082

A control-theoretic perspective on optimal high-order optimization (DOI)
DOI: 10.1007/S10107-021-01721-3