Backtracking gradient descent method and some applications in large scale optimisation. II: Algorithms and experiments

DOI10.1007/s00245-020-09718-8MaRDI QIDQ2234294

Tuyen Trung Truong, Hang-Tuan Nguyen

Publication date: 19 October 2021

Published in: Applied Mathematics and Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s00245-020-09718-8

zbMATH Keywords

global convergence; local minimum; random dynamical systems; image classification; backtracking; gradient descent; deep neural networks; large scale optimisation; iterative optimisation; automation of learning rates

Mathematics Subject Classification ID

68Txx: Artificial intelligence

49Mxx: Numerical methods in optimal control

68Uxx: Computing methodologies and applications

65Kxx: Numerical methods for mathematical programming, optimization and variational techniques

Uses Software

• MNIST
• GitHub
• MBT-optimizer
• MobileNetV2