Pegasos: primal estimated sub-gradient solver for SVM

DOI10.1007/s10107-010-0420-4zbMath1211.90239OpenAlexW2125993116WikidataQ56095187 ScholiaQ56095187MaRDI QIDQ633112

Nathan Srebro, Yoram Singer, Andrew Cotter, Shai Shalev-Shwartz

Publication date: 31 March 2011

Published in: Mathematical Programming. Series A. Series B (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s10107-010-0420-4

zbMATH Keywords

stochastic gradient descentSVM

Mathematics Subject Classification ID

Nonlinear programming (90C30)

Related Items

Unnamed Item, Semi-discrete optimal transport: hardness, regularization and numerical solution, Robust cost-sensitive kernel method with Blinex loss and its applications in credit risk evaluation, Stochastic approximation with discontinuous dynamics, differential inclusions, and applications, Robust echo state network with sparse online learning, Optimal Convergence Rates for the Proximal Bundle Method, Block mirror stochastic gradient method for stochastic optimization, Nested cross-validation with ensemble feature selection and classification model for high-dimensional biological data, Adaptive proximal SGD based on new estimating sequences for sparser ERM, Random-reshuffled SARAH does not need full gradient computations, Large-Scale Linear RankSVM, Nonlinear optimization and support vector machines, Nonlinear optimization and support vector machines, Accelerated proximal stochastic dual coordinate ascent for regularized loss minimization, A deterministic rescaled perceptron algorithm, On coresets for support vector machines, Convergence Rates for Deterministic and Stochastic Subgradient Methods without Lipschitz Continuity, Stochastic (Approximate) Proximal Point Methods: Convergence, Optimality, and Adaptivity, Stochastic proximal linear method for structured non-convex problems, Stochastic subgradient descent method for large-scale robust chance-constrained support vector machines, A nearest-neighbor search model for distance metric learning, Two new decomposition algorithms for training bound-constrained support vector machines, Binary vectors for fast distance and similarity estimation, Apportioned margin approach for cost sensitive large margin classifiers, On data preconditioning for regularized loss minimization, One-pass AUC optimization, Stochastic forward-backward splitting for monotone inclusions, A comparative study on large scale kernelized support vector machines, New smoothing SVM algorithm with tight error bound and efficient reduced techniques, Distributed Block Coordinate Descent for Minimizing Partially Separable Functions, Supervised classification and mathematical optimization, Uncertainty-safe large scale support vector machines, Online active classification via margin-based and feature-based label queries, Unnamed Item, Incremental learning for \(\nu\)-support vector regression, One-pass online learning: a local approach, A multi-class SVM approach based on the \( l_1\)-norm minimization of the distances between the reduced convex hulls, Block Stochastic Gradient Iteration for Convex and Nonconvex Optimization, Algorithms for stochastic optimization with function or expectation constraints, Online strongly convex optimization with unknown delays, Improving kernel online learning with a snapshot memory, An optimal subgradient algorithm with subspace search for costly convex optimization problems, Fast structured prediction using large margin sigmoid belief networks, A fast SVD-hidden-nodes based extreme learning machine for large-scale data analytics, Image annotation by propagating labels from semantic neighbourhoods, Block coordinate descent algorithms for large-scale sparse multiclass classification, Bridging the gap between constant step size stochastic gradient descent and Markov chains, Maxi-Min discriminant analysis via online learning, Linear classifiers are nearly optimal when hidden variables have diverse effects, Insensitive stochastic gradient twin support vector machines for large scale problems, An efficient method for clustered multi-metric learning, Pegasos: primal estimated sub-gradient solver for SVM, The online performance estimation framework: heterogeneous ensemble learning for data streams, Batched Stochastic Gradient Descent with Weighted Sampling, Spectral projected subgradient method for nonsmooth convex optimization problems, Dynamical memory control based on projection technique for online regression, Incremental proximal methods for large scale convex optimization, Unnamed Item, Cutting-plane training of structural SVMs, Periodic step-size adaptation in second-order gradient descent for single-pass on-line structured learning, Structured prediction by joint kernel support estimation, Training parsers by inverse reinforcement learning, Fast learning of relational kernels, Hierarchical linear support vector machine, Training Lp norm multiple kernel learning in the primal, An efficient augmented Lagrangian method for support vector machine, Image classification with the Fisher vector: theory and practice, Large-scale linear nonparallel support vector machine solver, How Effectively Train Large-Scale Machine Learning Models?, Unnamed Item, On the complexity of parallel coordinate descent, Classification of high-dimensional evolving data streams via a resource-efficient online ensemble, Optimization Methods for Large-Scale Machine Learning, A novel Frank-Wolfe algorithm. Analysis and applications to large-scale SVM training, Kernel-based online regression with canal loss, Minimizing finite sums with the stochastic average gradient, An incremental subgradient method on Riemannian manifolds, New nonasymptotic convergence rates of stochastic proximal point algorithm for stochastic convex optimization, Object tracking by incremental structural learning of deformable parts, Stochastic Subgradient Estimation Training for Support Vector Machines, New machine-learning algorithms for prediction of Parkinson's disease, A primal sub-gradient method for structured classification with the averaged sum loss, Convergence of stochastic proximal gradient algorithm, Unnamed Item, Unnamed Item, Unnamed Item, Julia language in machine learning: algorithms, applications, and open issues, Unnamed Item, Parallel decomposition methods for linearly constrained problems subject to simple bound with application to the SVMs training, Subgradient-based neural network for nonconvex optimization problems in support vector machines with indefinite kernels, Relatively-paired space analysis: learning a latent common space from relatively-paired observations, Stream-suitable optimization algorithms for some soft-margin support vector machine variants, Inexact stochastic subgradient projection method for stochastic equilibrium problems with nonmonotone bifunctions: application to expected risk minimization in machine learning, An algebraic characterization of the optimum of regularized kernel methods, Stochastic proximal splitting algorithm for composite minimization, Unnamed Item, Online training on a budget of support vector machines using twin prototypes, Large‐margin classification with multiple decision rules, Developing an online general type-2 fuzzy classifier using evolving type-1 rules, Decentralized hierarchical constrained convex optimization, A hybrid acceleration strategy for nonparallel support vector machine, Fast and strong convergence of online learning algorithms, Pegasos, Hyper-parameter optimization for support vector machines using stochastic gradient descent and dual coordinate descent, Coordinate descent with arbitrary sampling I: algorithms and complexity^†, Making the Last Iterate of SGD Information Theoretically Optimal, Sparse classification: a scalable discrete optimization perspective, The incremental subgradient methods on distributed estimations in-network, Unnamed Item, An efficient primal dual prox method for non-smooth optimization, Unnamed Item, Unnamed Item, Bilevel hyperparameter optimization for support vector classification: theoretical analysis and a solution method, On the perceptron's compression, On stochastic accelerated gradient with convergence rate, Premise selection for mathematics by corpus analysis and kernel methods, A reduced proximal-point homotopy method for large-scale non-convex BQP, Proximal Gradient Methods for Machine Learning and Imaging, Incremental accelerated gradient methods for SVM classification: study of the constrained approach

Uses Software

• SVMlight

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Primal-dual subgradient methods for convex problems
• Pegasos: primal estimated sub-gradient solver for SVM
• Statistical analysis of learning dynamics
• Large margin classification using the perceptron algorithm
• Some results on Tchebycheffian spline functions and stochastic processes
• 10.1162/15324430260185619
• On the Generalization Ability of On-Line Learning Algorithms
• Introduction to Stochastic Search and Optimization
• Training a Support Vector Machine in the Primal
• Logarithmic Regret Algorithms for Online Convex Optimization
• Online Learning with Kernels
• Convex Analysis