Insensitive stochastic gradient twin support vector machines for large scale problems
From MaRDI portal
Publication:2198233
Abstract: Stochastic gradient descent algorithm has been successfully applied on support vector machines (called PEGASOS) for many classification problems. In this paper, stochastic gradient descent algorithm is investigated to twin support vector machines for classification. Compared with PEGASOS, the proposed stochastic gradient twin support vector machines (SGTSVM) is insensitive on stochastic sampling for stochastic gradient descent algorithm. In theory, we prove the convergence of SGTSVM instead of almost sure convergence of PEGASOS. For uniformly sampling, the approximation between SGTSVM and twin support vector machines is also given, while PEGASOS only has an opportunity to obtain an approximation of support vector machines. In addition, the nonlinear SGTSVM is derived directly from its linear case. Experimental results on both artificial datasets and large scale problems show the stable performance of SGTSVM with a fast learning speed.
Recommendations
- A novel twin parametric support vector machine for large scale problem
- Pegasos: primal estimated sub-gradient solver for SVM
- Large-scale linear nonparallel support vector machine solver
- A coordinate descent margin based-twin support vector machine for classification
- Incremental twin support vector machines
Cites work
- scientific article; zbMATH DE number 3238721 (Why is no real title available?)
- scientific article; zbMATH DE number 961607 (Why is no real title available?)
- A GA-based model selection for smooth twin parametric-margin support vector machine
- A coordinate descent margin based-twin support vector machine for classification
- A novel Frank-Wolfe algorithm. Analysis and applications to large-scale SVM training
- Almost sure convergence of a stochastic approximation process in a convex set
- An efficient weighted Lagrangian twin support vector machine for imbalanced data classification
- LIBLINEAR: a library for large linear classification
- Large-scale linear nonparallel support vector machine solver
- MLTSVM: a novel twin support vector machine to multi-label learning
- Nonparallel hyperplane support vector machine for binary classification problems
- Optimal kernel selection in twin support vector machines
- Pattern classification.
- Pegasos: primal estimated sub-gradient solver for SVM
- Robust twin support vector machine for pattern classification
- SSVM: A smooth support vector machine for classification
- Stochastic gradient descent with Barzilai-Borwein update step for SVM
- Support-vector networks
- TPMSVM: A novel twin parametric-margin support vector machine for pattern recognition
- The new interpretation of support vector machines on statistical learning theory
- Twin support vector machine with Universum data
Cited in
(10)- Smooth augmented Lagrangian method for twin bounded support vector machine
- R-CTSVM+: robust capped \(\mathrm{L}_1\)-norm twin support vector machine with privileged information
- A novel twin parametric support vector machine for large scale problem
- General twin support vector machine with pinball loss function
- A novel regularization method for decorrelation learning of non-parallel hyperplanes
- Pegasos: primal estimated sub-gradient solver for SVM
- Comprehensive review on twin support vector machines
- Locally finite distance clustering with discriminative information
- scientific article; zbMATH DE number 7829182 (Why is no real title available?)
- Business analytics for corporate risk management and performance improvement
This page was built for publication: Insensitive stochastic gradient twin support vector machines for large scale problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2198233)