Application of Monte Carlo stochastic optimization (MOST) to deep learning

DOI10.1016/J.MATCOM.2022.03.013MaRDI QIDQ2672369zbMATH OpenOpenAlexFDO

Authors Sin-ichi Inage, Hana Hebishima

Publication date 8 June 2022

Published in Mathematics and Computers in Simulation (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2109.02441

zbMATH Keywords

Adamdeep learninggenetic algorithmMonte Carlo methodneural networkoptimization algorithms

Mathematics Subject Classification ID

Numerical analysis (65-XX) Operations research, mathematical programming (90-XX)

Recommendations

• Proposal and validation of an optimization method using Monte Carlo method for multi-objective functions
• A modification of adaptive moment estimation (Adam) for machine learning
• Adaptive methods using element-wise pth power of stochastic gradient for nonconvex optimization in deep neural networks
• Optimization problems for machine learning: a survey
• scientific article; zbMATH DE number 433029

Cites work

• Adaptive subgradient methods for online learning and stochastic optimization
• scientific article; zbMATH DE number 3850830 (Why is no real title available?)
• scientific article; zbMATH DE number 194544 (Why is no real title available?)
• Learning representations by back-propagating errors

Cited in

(2)

• Proposal and validation of an optimization method using Monte Carlo method for multi-objective functions
• Enhancing deep learning algorithm accuracy and stability using multicriteria optimization: an application to distributed learning with MNIST digits

Describes a project that uses

Uses Software

• ADADELTA
• Adam
• AdaGrad

This page was built for publication: Application of Monte Carlo stochastic optimization (MOST) to deep learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2672369)