ASD+M: automatic parameter tuning in stochastic optimization and on-line learning

DOI10.1016/J.NEUNET.2017.07.007MaRDI QIDQ2179079zbMATH OpenOpenAlexWikidataFDO

Authors Paweł Wawrzyński

Publication date 12 May 2020

Published in Neural Networks (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.neunet.2017.07.007

zbMATH Keywords

deep learningonline learningstochastic gradient descentlearning ratestep-sizeclassic momentum

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Stochastic programming (90C15)

Recommendations

• scientific article; zbMATH DE number 2247821
• Adaptive Sequential Stochastic Optimization
• Adaptive subgradient methods for online learning and stochastic optimization
• Learning automata and stochastic optimization
• Continuous action set learning automata for stochastic optimization
• scientific article; zbMATH DE number 1569106
• On the adaptivity of stochastic gradient-based optimization
• scientific article; zbMATH DE number 3959133

Cites work

• scientific article; zbMATH DE number 3850830 (Why is no real title available?)
• scientific article; zbMATH DE number 1043533 (Why is no real title available?)
• A Stochastic Approximation Method
• Adaptive stepsizes for recursive estimation with applications in approximate dynamic programming
• An optimal method for stochastic composite optimization
• Autonomous reinforcement learning with experience replay
• Reducing the Dimensionality of Data with Neural Networks
• SGD-QN: careful quasi-Newton stochastic gradient descent
• Some methods of speeding up the convergence of iteration methods
• Steepest descent with momentum for quadratic functions is a version of the conjugate gradient method

Cited in

(4)

• scientific article; zbMATH DE number 1569106 (Why is no real title available?)
• ASD+M
• scientific article; zbMATH DE number 1928655 (Why is no real title available?)
• To raise or not to raise: the autonomous learning rate question

Describes a project that uses

Uses Software

• SGD-QN
• darch
• UCI

This page was built for publication: ASD+M: automatic parameter tuning in stochastic optimization and on-line learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2179079)