Generalization error rates in kernel regression: the crossover from the noiseless to noisy regime*

DOI10.1088/1742-5468/AC9829MaRDI QIDQ5055412zbMATH OpenOpenAlexFDO

Authors Hugo Cui, Bruno Loureiro, Florent Krzakala, Lenka Zdeborová

Publication date 13 December 2022

Published in Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/2105.15004

zbMATH Keywords

learning theorymachine learning

Mathematics Subject Classification ID

Statistical mechanics, structure of matter (82-XX)

Recommendations

• Just interpolate: kernel ``ridgeless regression can generalize
• Kernel regression, minimax rates and effective dimensionality: beyond the regular case
• Regularization in kernel learning
• Generalization bounds of a compressed regression learning algorithm
• Learning with generalization capability by kernel methods of bounded complexity

Cites work

• scientific article; zbMATH DE number 3790208 (Why is no real title available?)
• scientific article; zbMATH DE number 7306870 (Why is no real title available?)
• scientific article; zbMATH DE number 3221828 (Why is no real title available?)
• scientific article; zbMATH DE number 3222478 (Why is no real title available?)
• Acceleration of Stochastic Approximation by Averaging
• Asymptotic learning curves of kernel methods: empirical data versus teacher–student paradigm
• Bayesian learning for neural networks
• Benign overfitting in linear regression
• Concentration of measure and isoperimetric inequalities in product spaces
• Eigenvectors of some large sample covariance matrix ensembles
• High-dimensional asymptotics of prediction: ridge regression and classification
• High-dimensional dynamics of generalization error in neural networks
• Optimal rates for spectral algorithms with least-squares regression over Hilbert spaces
• Optimal rates for the regularized least-squares algorithm
• Precise Error Analysis of Regularized <inline-formula> <tex-math notation="LaTeX">$M$ </tex-math> </inline-formula>-Estimators in High Dimensions
• Ridge regression and asymptotic minimax estimation over spheres of growing dimension
• Scikit-learn: machine learning in Python
• Sobolev norm learning rates for regularized least-squares algorithms
• Support vector machines learning noisy polynomial rules
• Surprises in high-dimensional ridgeless least squares interpolation
• Two models of double descent for weak features
• When do neural networks outperform kernel methods?*

Cited in

(2)

• Learning sparse features can lead to overfitting in neural networks
• On expected error of randomized Nyström kernel regression

Describes a project that uses

Uses Software

• Scikit

This page was built for publication: Generalization error rates in kernel regression: the crossover from the noiseless to noisy regime*

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5055412)