Nonparametric regression using needlet kernels for spherical data
From MaRDI portal
Abstract: Needlets have been recognized as state-of-the-art tools to tackle spherical data, due to their excellent localization properties in both spacial and frequency domains. This paper considers developing kernel methods associated with the needlet kernel for nonparametric regression problems whose predictor variables are defined on a sphere. Due to the localization property in the frequency domain, we prove that the regularization parameter of the kernel ridge regression associated with the needlet kernel can decrease arbitrarily fast. A natural consequence is that the regularization term for the kernel ridge regression is not necessary in the sense of rate optimality. Based on the excellent localization property in the spacial domain further, we also prove that all the kernel regularization estimates associated with the needlet kernel, including the kernel lasso estimate and the kernel bridge estimate, possess almost the same generalization capability for a large range of regularization parameters in the sense of rate optimality. This finding tentatively reveals that, if the needlet kernel is utilized, then the choice of might not have a strong impact in terms of the generalization capability in some modeling contexts. From this perspective, can be arbitrarily specified, or specified merely by other no generalization criteria like smoothness, computational complexity, sparsity, etc..
Recommendations
Cites work
- L^p Bernstein estimates and approximation by spherical basis functions
- A distribution-free theory of nonparametric regression
- Approximation methods for supervised learning
- Approximation of smooth functions on compact two-point homogeneous spaces
- Approximation properties of zonal function networks using scattered data on the sphere
- Approximation with polynomial kernels and SVM classifiers
- Asymptotics for spherical needlets
- Best choices for regularization parameters in learning theory: on the bias-variance problem.
- CMB data analysis and sparsity
- Concentration estimates for learning with \(\ell ^{1}\)-regularizer and data dependent hypothesis spaces
- Concentration inequalities and confidence bands for needlet density estimators on compact homogeneous manifolds
- Decomposition of Besov and Triebel-Lizorkin spaces on the sphere
- Distributed kernel-based gradient descent algorithms
- Filtered hyperinterpolation: a constructive polynomial approximation on the sphere
- scientific article; zbMATH DE number 5000378 (Why is no real title available?)
- scientific article; zbMATH DE number 1128580 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Learning Rates of lq Coefficient Regularization Learning with Gaussian Kernel
- Learning rates of regularized regression on the unit sphere
- Learning Theory
- Learning theory estimates via integral operators and their approximations
- Learning with sample dependent hypothesis spaces
- Least square regression with \(l^{p}\)-coefficient regularization
- Localized linear polynomial operators and quadrature formulas on the sphere
- Localized Tight Frames on Spheres
- Nonparametric Regression for Spherical Data
- Nonparametric regression on the hyper-sphere with uniform design
- On power and sample size determinations for the Wilcoxon–Mann–Whitney test
- On the degree of approximation by manifolds of finite pseudo-dimension
- On the mathematical foundations of learning
- On the representation of smooth functions on the sphere using finitely many bits
- Optimal rates for the regularized least-squares algorithm
- Polynomial operators and local smoothness classes on the unit interval
- Probabilistic spherical Marcinkiewicz-Zygmund inequalities
- Pseudo-dimension and entropy of manifolds formed by affine-invariant dictionary
- Regularized least square regression with spherical polynomial kernels
- Some properties of Gaussian reproducing kernel Hilbert spaces and their implications for function approximation and learning theory
- Spherical harmonics
- Spherical Marcinkiewicz-Zygmund inequalities and positive quadrature
- Spherical regression
- Support Vector Machines
Cited in
(13)- Nonparametric regression on the hyper-sphere with uniform design
- Asymptotic behaviour of level sets of needlet random fields
- Improving kernel-based nonparametric regression for circular-linear data
- Recent advances in directional statistics
- Complexity of Monte Carlo integration for Besov classes on the unit sphere
- Adaptive global thresholding on the sphere
- Nonparametric Regression for Spherical Data
- Distributed filtered hyperinterpolation for noisy data on the sphere
- Radial basis function approximation with distributively stored data on spheres
- Local Fréchet regression with spherical predictors
- Deterministic error analysis of kernel regularized regression for spherical scattered data
- Optimal designs for regression on Lie groups
- Truncated kernel stochastic gradient descent on spheres
This page was built for publication: Nonparametric regression using needlet kernels for spherical data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1633627)
