Parsimonious online learning with kernels via sparse projections in function space

zbMATH Open1483.68304arXiv1612.04111MaRDI QIDQ4633012FDOQ4633012

Authors: Alec Koppel, Garrett Warnell, Ethan Stump, Alejandro Ribeiro 

Publication date: 2 May 2019

Full work available at URL: https://arxiv.org/abs/1612.04111

Recommendations

• Large scale online kernel learning
• scientific article; zbMATH DE number 1931826
• Consistent online Gaussian process regression without the sample complexity bottleneck
• Approximation vector machines for large-scale online learning
• \textsf{StreaMRAK} a streaming multi-resolution adaptive kernel algorithm

zbMATH Keywords

supervised learningnonparametric regressionkernel methodsstochastic optimizationonline learningorthogonal matching pursuit

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Learning and adaptive systems in artificial intelligence (68T05) Online algorithms; streaming algorithms (68W27) Stochastic approximation (62L20) Stochastic programming (90C15)

Cites Work

• Regularization networks and support vector machines
• Title not available (Why is that?)
• Some results on Tchebycheffian spline functions and stochastic processes
• Machine learning. A probabilistic perspective
• Nonparametric stochastic approximation with large step-sizes
• Updating Quasi-Newton Matrices with Limited Storage
• A Stochastic Approximation Method
• Global convergence of online limited memory BFGS
• SGD-QN: careful quasi-Newton stochastic gradient descent
• Title not available (Why is that?)
• RES: Regularized Stochastic BFGS Algorithm
• Cutting-plane training of structural SVMs
• The restricted isometry property and its implications for compressed sensing
• Title not available (Why is that?)
• Neural Network Learning
• The Kernel Recursive Least-Squares Algorithm
• The covering number in learning theory
• Learning Multiscale Sparse Representations for Image and Video Restoration
• Title not available (Why is that?)
• Online Learning with Kernels
• Fast kernel classifiers with online and active learning
• Kernel Learning Algorithms for Face Recognition
• Representing and recognizing the visual appearance of materials using three-dimensional textons
• Learnability, stability and uniform convergence
• The Kernel Least-Mean-Square Algorithm
• Online Regularized Classification Algorithms
• Kernel matching pursuit
• A note on different covering numbers in learning theory.
• Online Prediction of Time Series Data With Kernels
• Minimizing finite sums with the stochastic average gradient
• Adaptive Kernel-Based Image Denoising Employing Semi-Parametric Regularization
• Breaking the curse of kernelization: budgeted stochastic gradient descent for large-scale SVM training
• Large scale online kernel learning
• Parsimonious online learning with kernels via sparse projections in function space
• Online training on a budget of support vector machines using twin prototypes
• On stochastic optimization and statistical learning in reproducing kernel Hilbert spaces by support vector machines (SVM)

Cited In (13)

• Approximation vector machines for large-scale online learning
• A sieve stochastic gradient descent estimator for online nonparametric regression in Sobolev ellipsoids
• Online Nonlinear Estimation via Iterative <inline-formula> <tex-math notation="LaTeX">$L^2$</tex-math> </inline-formula>-Space Projections: Reproducing Kernel of Subspace
• \textsf{StreaMRAK} a streaming multi-resolution adaptive kernel algorithm
• Spatially-Dimension-Adaptive Sparse Grids for Online Learning
• Parsimonious online learning with kernels via sparse projections in function space
• Sliding window generalized kernel affine projection algorithm using projection mappings
• Worst-case regret analysis of computationally budgeted online kernel selection
• Consistent online Gaussian process regression without the sample complexity bottleneck
• On the strong convergence of forward-backward splitting in reconstructing jointly sparse signals
• Title not available (Why is that?)
• Theory and Applications of Models of Computation
• An Online Projection Estimator for Nonparametric Regression in Reproducing Kernel Hilbert Spaces

This page was built for publication: Parsimonious online learning with kernels via sparse projections in function space

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4633012)