Solving support vector machines in reproducing kernel Banach spaces with positive definite functions

DOI10.1016/J.ACHA.2014.03.007zbMATH Open1366.68236arXiv1209.1171OpenAlexW2112430772MaRDI QIDQ466976FDOQ466976

Authors: Gregory E. Fasshauer, Fred J. Hickernell, Qi Ye 

Publication date: 3 November 2014

Published in: Applied and Computational Harmonic Analysis (Search for Journal in Brave)

Abstract: In this paper we solve support vector machines in reproducing kernel Banach spaces with reproducing kernels defined on nonsymmetric domains instead of the traditional methods in reproducing kernel Hilbert spaces. Using the orthogonality of semi-inner-products, we can obtain the explicit representations of the dual (normalized-duality-mapping) elements of support vector machine solutions. In addition, we can introduce the reproduction property in a generalized native space by Fourier transform techniques such that it becomes a reproducing kernel Banach space, which can be even embedded into Sobolev spaces, and its reproducing kernel is set up by the related positive definite function. The representations of the optimal solutions of support vector machines (regularized empirical risks) in these reproducing kernel Banach spaces are formulated explicitly in terms of positive definite functions, and their finite numbers of coefficients can be computed by fixed point iteration. We also give some typical examples of reproducing kernel Banach spaces induced by Mat'ern functions (Sobolev splines) so that their support vector machine solutions are well computable as the classical algorithms. Moreover, each of their reproducing bases includes information from multiple training data points. The concept of reproducing kernel Banach spaces offers us a new numerical tool for solving support vector machines.

Full work available at URL: https://arxiv.org/abs/1209.1171

Recommendations

• Support vector machines in reproducing kernel Hilbert spaces versus Banach spaces
• Reproducing kernel Banach spaces for machine learning
• Generalized Mercer kernels and reproducing kernel Banach spaces
• Construction of Pairs of Reproducing Kernel Banach Spaces
• Sparse support vector machines in reproducing kernel Banach spaces

zbMATH Keywords

support vector machinereproducing kernelpositive definite functionregularized empirical riskreproducing kernel Banach spaceSobolev splineMatérn function

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05) Fourier and Fourier-Stieltjes transforms and other transforms of Fourier type (42B10)

Cites Work

• Interpolation of spatial data. Some theory for kriging
• Support Vector Machines
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Scattered Data Approximation
• Title not available (Why is that?)
• Proximity algorithms for image models: denoising
• Meshfree approximation methods with Matlab. With CD-ROM.
• Title not available (Why is that?)
• An Introduction to Banach Space Theory
• Radial Basis Functions
• Reproducing kernel Banach spaces for machine learning
• Semi-Inner-Product Spaces
• Title not available (Why is that?)
• Classes of Semi-Inner-Product Spaces
• Orthogonality and Linear Functionals in Normed Linear Spaces
• Reproducing kernels of Sobolev spaces via a Green kernel approach with differential operators and boundary operators
• Reproducing kernels of generalized Sobolev spaces via a Green function approach with distributional operators
• Introduction to machine learning.
• Reproducing kernel Banach spaces with the \(\ell^1\) norm
• Reproducing kernel Banach spaces with the \(\ell^{1}\) norm. II: Error analysis for regularized least square regression
• Support vector machines in reproducing kernel Hilbert spaces versus Banach spaces
• Generalized native spaces
• Learning Theory
• Regularized learning in Banach spaces as an optimization problem: representer theorems

Cited In (21)

• Title not available (Why is that?)
• Multikernel regression with sparsity constraint
• Generalized Mercer kernels and reproducing kernel Banach spaces
• Weighted \(p\)-regular kernels for reproducing kernel Hilbert spaces and Mercer theorem
• Error analysis of the kernel regularized regression based on refined convex losses and RKBSs
• A shooting reproducing kernel Hilbert space method for multiple solutions of nonlinear boundary value problems
• Multi-task learning in vector-valued reproducing kernel Banach spaces with the \(\ell^1\) norm
• An iterative reproducing kernel method in Hilbert space for the multi-point boundary value problems
• Bounded composition operators on functional quasi-Banach spaces and stability of dynamical systems
• Margin error bounds for support vector machines on reproducing kernel Banach spaces
• Separability of reproducing kernel spaces
• Riesz basis-based reproducing kernel and SVM
• Generalized representer theorems in Banach spaces
• Representation for the reproducing kernel Hilbert space method for a nonlinear system
• Sparse support vector machines in reproducing kernel Banach spaces
• Sparse machine learning in Banach spaces
• On relative reproducing kernel Banach spaces: definitions, semi-inner product and feature maps
• On reproducing kernel Banach spaces: generic definitions and unified framework of constructions
• Generalized support vector regression: duality and tensor-kernel representation
• Regularized learning schemes in feature Banach spaces
• Support vector machines in reproducing kernel Hilbert spaces versus Banach spaces

Uses Software

• Matlab

This page was built for publication: Solving support vector machines in reproducing kernel Banach spaces with positive definite functions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q466976)