Parallel optimization techniques for machine learning

DOI10.1007/978-3-030-43736-7_13zbMATH Open1448.68374OpenAlexW3038327432MaRDI QIDQ3300501FDOQ3300501

Authors Sudhir Kylasa, Chih-Hao Fang, Fred Roosta, Ananth Grama 

Publication date 29 July 2020

Published in Parallel Algorithms in Computational Science and Engineering (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/978-3-030-43736-7_13

zbMATH Keywords

trust-region frameworknatural gradientADMM-based optimization frameworkKronecker factored approximated curvature (KFAC)sub-sampled Newton-type methods

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Learning and adaptive systems in artificial intelligence (68T05) Parallel numerical computation (65Y05)

• Survey on parallel and distributed optimization algorithms for scalable machine learning
• Second-order stochastic optimization for machine learning in linear time
• First-order and stochastic optimization methods for machine learning
• Large-scale machine learning with stochastic gradient descent
• Optimization methods for large-scale machine learning

• scientific article; zbMATH DE number 1321699 (Why is no real title available?)
• scientific article; zbMATH DE number 2107836 (Why is no real title available?)
• scientific article; zbMATH DE number 5060482 (Why is no real title available?)
• A Stochastic Approximation Method
• A method for the solution of certain non-linear problems in least squares
• A quasi-Newton approach to nonsmooth convex optimization problems in machine learning
• Adaptive subgradient methods for online learning and stochastic optimization
• An Algorithm for Least-Squares Estimation of Nonlinear Parameters
• Distributed optimization and statistical learning via the alternating direction method of multipliers
• Introductory lectures on convex optimization. A basic course.
• Invex functions and constrained local minima
• Large-scale machine learning with stochastic gradient descent
• Numerical Optimization
• On the limited memory BFGS method for large scale optimization
• On the use of stochastic Hessian information in optimization methods for machine learning
• Optimization methods for large-scale machine learning
• Sample size selection in optimization methods for machine learning
• Some methods of speeding up the convergence of iteration methods
• The elements of statistical learning. Data mining, inference, and prediction
• Trust Region Methods
• Trust region Newton method for logistic regression
• Understanding machine learning. From theory to algorithms
• Updating Quasi-Newton Matrices with Limited Storage

Cited In (3)

• Survey on parallel and distributed optimization algorithms for scalable machine learning
• Parallel concurrent ML
• Neural nets with a Newton conjugate gradient method on multiple GPUs

Uses Software

• L-BFGS
• TensorFlow
• AdaGrad
• RMSprop
• Adam
• AlphaGo
• AIDE
• ADADELTA

This page was built for publication: Parallel optimization techniques for machine learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3300501)