A new class of nonmonotone conjugate gradient training algorithms

DOI10.1016/J.AMC.2015.05.053zbMATH Open1410.65235OpenAlexW628352727MaRDI QIDQ669374FDOQ669374

Authors: Ioannis E. Livieris, Panagiotis Pintelas 

Publication date: 15 March 2019

Published in: Applied Mathematics and Computation (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.amc.2015.05.053

Recommendations

• A new conjugate gradient algorithm for training neural networks based on a modified secant equation
• A new class of conjugate gradient methods with extended nonmonotone line search
• Performance evaluation of descent CG methods for neural network training
• A nonmonotone conjugate gradient algorithm for unconstrained optimization
• A new family of conjugate gradient methods

zbMATH Keywords

artificial neural networksglobal convergenceconjugate gradient algorithmnonmonotone line search

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Numerical optimization and variational techniques (65K10) Learning and adaptive systems in artificial intelligence (68T05) Neural networks for/in biological studies, artificial life and related topics (92B20)

Cites Work

• Numerical Optimization
• Benchmarking optimization software with performance profiles.
• Function minimization by conjugate gradients
• Title not available (Why is that?)
• A descent modified Polak–Ribière–Polyak conjugate gradient method and its global convergence
• Methods of conjugate gradients for solving linear systems
• Exponential stability of continuous-time and discrete-time cellular neural networks with delays
• A Nonmonotone Line Search Technique for Newton’s Method
• Title not available (Why is that?)
• The convergence of conjugate gradient method with nonmonotone line search
• A survey of nonlinear conjugate gradient methods
• Global convergence of a modified Fletcher-Reeves conjugate gradient method with Armijo-type line search
• Globally convergent modified Perry's conjugate gradient method
• On the nonmonotone line search
• Global convergence of nonmonotone descent methods for unconstrained optimization problems
• Two descent hybrid conjugate gradient methods for optimization
• Sufficient descent nonlinear conjugate gradient methods with conjugacy condition
• Title not available (Why is that?)
• Two modified Dai-Yuan nonlinear conjugate gradient methods
• Avoiding the Maratos Effect by Means of a Nonmonotone Line Search I. General Constrained Problems
• Convergence of descent method without line search
• Modified nonmonotone Armijo line search for descent method
• A dynamic all parameters adaptive BP neural networks model and its application on oil reservoir prediction
• Forecasting electrical consumption by integration of neural network, time series and ANOVA
• Performance evaluation of descent CG methods for neural network training
• A comparative study of neural network based feature extraction paradigms
• Integration of artificial neural networks and genetic algorithm to predict electrical energy consumption
• A new conjugate gradient algorithm for training neural networks based on a modified secant equation

Cited In (4)

• Performance evaluation of descent CG methods for neural network training
• Accelerating optimization by tracing valley
• A new conjugate gradient algorithm for training neural networks based on a modified secant equation
• An auto-adjustable semi-supervised self-training algorithm

Uses Software

• UCI-ml

This page was built for publication: A new class of nonmonotone conjugate gradient training algorithms

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q669374)