AdaLo: adaptive learning rate optimizer with loss for classification
From MaRDI portal
Recommendations
- A control theoretic framework for adaptive gradient optimizers
- Adaptive learning rate optimization algorithms with dynamic bound based on Barzilai-Borwein method
- A modification of adaptive moment estimation (Adam) for machine learning
- Automatic, dynamic, and nearly optimal learning rate specification via local quadratic approximation
- Adaptive methods using element-wise pth power of stochastic gradient for nonconvex optimization in deep neural networks
Cites work
- A Stochastic Approximation Method
- Adaptive subgradient methods for online learning and stochastic optimization
- Anti-disturbance state estimation for PDT-switched RDNNs utilizing time-sampling and space-splitting measurements
- Deep learning for generic object detection: a survey
- Deep learning: methods and applications
- PINN-FORM: a new physics-informed neural network for reliability analysis with partial differential equation
- Predicting citywide crowd flows using deep spatio-temporal residual networks
Cited in
(4)- Adaptive learning rate optimization algorithms with dynamic bound based on Barzilai-Borwein method
- A control theoretic framework for adaptive gradient optimizers
- Advancing neural network calibration: the role of gradient decay in large-margin Softmax optimization
- Stochastic perturbation of subgradient algorithm for nonconvex deep neural networks
This page was built for publication: AdaLo: adaptive learning rate optimizer with loss for classification
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6645078)