A relaxed vector auxiliary variable algorithm for unconstrained optimization problems

DOI10.1137/23M1611087MaRDI QIDQ7023521zbMATH OpenFDO

Authors Shiheng Zhang, Jiahao Zhang, Jie Shen, Guang Lin

Publication date 21 February 2025

Published in SIAM Journal on Scientific Computing (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1137/23M1611087

zbMATH Keywords

optimizationmachine learninggradient descentadaptive learning rateSAV

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Learning and adaptive systems in artificial intelligence (68T05) Nonconvex programming, global optimization (90C26)

Cites work

• scientific article; zbMATH DE number 3009276 (Why is no real title available?)
• scientific article; zbMATH DE number 2107836 (Why is no real title available?)
• scientific article; zbMATH DE number 3101095 (Why is no real title available?)
• A new class of efficient and robust energy stable schemes for gradient flows
• AEGD: adaptive gradient descent with energy
• An Efficient and Robust Scalar Auxialiary Variable Based Algorithm for Discrete Gradient Systems Arising from Optimizations
• Convergence and error analysis for the scalar auxiliary variable (SAV) schemes to gradient flows
• Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward-backward splitting, and regularized Gauss-Seidel methods
• DIFFUSE-INTERFACE METHODS IN FLUID MECHANICS
• Deep learning
• Discrete versus continuous Newton's method: A case study
• Improving the accuracy and consistency of the scalar auxiliary variable (SAV) method with relaxation
• Linear, first and second-order, unconditionally energy stable numerical schemes for the phase field model of homopolymer blends
• Numerical approximations for a phase field dendritic crystal growth model based on the invariant energy quadratization approach
• Numerical approximations of Allen-Cahn and Cahn-Hilliard equations
• On an application of dynamical systems theory to determine all the zeros of a vector function
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Second-order convex splitting schemes for gradient flows with Ehrlich-Schwoebel type energy: Application to thin film epitaxy
• Some effective methods for unconstrained optimization based on the solution of systems of ordinary differential equations
• Stochastic Steffensen method
• The Global Dynamics of Discrete Semilinear Parabolic Equations
• The scalar auxiliary variable (SAV) approach for gradient flows

Cited in

(1)

• SAV-based entropy-dissipative schemes for a class of kinetic equations

This page was built for publication: A relaxed vector auxiliary variable algorithm for unconstrained optimization problems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q7023521)