A gradient descent method for solving a system of nonlinear equations

DOI10.1016/J.AML.2020.106739MaRDI QIDQ2213706zbMATH OpenOpenAlexFDO

Authors Wenrui Hao

Publication date 3 December 2020

Published in Applied Mathematics Letters (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.aml.2020.106739

zbMATH Keywords

convergence analysisgradient descent methodsystems of nonlinear equations

Mathematics Subject Classification ID

Numerical computation of solutions to systems of equations (65H10) Methods of quasi-Newton type (90C53)

Recommendations

• scientific article; zbMATH DE number 3932308
• Adaptive Gauss-Newton method for solving systems of nonlinear equations
• On the global convergence of an inexact quasi-Newton conditional gradient method for constrained nonlinear systems
• Publication:4937618
• A Liu-Storey conjugate gradient method for solving large-scale nonlinear system of equations with global convergence

Cites work

• A bootstrapping approach for computing multiple solutions of differential equations
• A homotopy method for parameter estimation of nonlinear differential equations with multiple optima
• A homotopy training algorithm for fully connected neural networks
• A survey of numerical methods for solving nonlinear integral equations
• Alternate step gradient method*
• An equation-by-equation method for solving the multidimensional moment constrained maximum entropy problem
• Global inexact Newton methods for very large scale nonlinear problems
• scientific article; zbMATH DE number 1274356 (Why is no real title available?)
• scientific article; zbMATH DE number 852532 (Why is no real title available?)
• scientific article; zbMATH DE number 852536 (Why is no real title available?)
• scientific article; zbMATH DE number 5060482 (Why is no real title available?)
• Inexact Newton Methods
• Jacobian-free Newton-Krylov methods: a survey of approaches and applications.
• Large-scale machine learning with stochastic gradient descent
• Numerically solving polynomial systems with Bertini
• On convergence rates for the iteratively regularized Gauss-newton method
• Optimization methods for large-scale machine learning
• Real solutions to systems of polynomial equations and parameter continuation
• Relaxed steepest descent and Cauchy-Barzilai-Borwein method
• Step-sizes for the gradient method
• The method of steepest descent for non-linear minimization problems
• Two-Point Step Size Gradient Methods

Cited in

(9)

• A weight initialization based on the linear product structure for neural networks
• Iterative gradient descent methods for solving linear equations
• scientific article; zbMATH DE number 5060417 (Why is no real title available?)
• An adaptive gradient-descent-based neural networks for the on-line solution of linear time variant equations and its applications
• On stochastic block methods for solving nonlinear equations
• A stochastic column-block gradient descent method for solving nonlinear systems of equations
• Equilibrated flux a posteriori error estimates and adaptivity for nonlinear and doubly degenerate elliptic problems
• On the application of explicit Runge-Kutta methods to the construction of stochastic gradient descent methods for convex optimization
• A method of inexact steepest descent for systems of linear equations

Describes a project that uses

Uses Software

• KELLEY
• Adam
• Bertini

This page was built for publication: A gradient descent method for solving a system of nonlinear equations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2213706)