The Generalization Error of Random Features Regression: Precise Asymptotics and the Double Descent Curve
From MaRDI portal
Publication:5072044
Recommendations
- A random matrix analysis of random Fourier features: beyond the Gaussian kernel, a precise phase transition, and the corresponding double descent*
- Triple descent and the two kinds of overfitting: where and why do they appear?*
- Surprises in high-dimensional ridgeless least squares interpolation
- Two models of double descent for weak features
- Generalisation error in learning with random features and the hidden manifold model*
Cited in
(42)- The generalization error of random features regression: Precise asymptotics and double descent curve
- A simple probabilistic neural network for machine understanding
- High-Dimensional Analysis of Double Descent for Linear Regression with Random Projections
- Mehler’s Formula, Branching Process, and Compositional Kernels of Deep Neural Networks
- Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks
- A Unifying Tutorial on Approximate Message Passing
- AdaBoost and robust one-bit compressed sensing
- Universality of approximate message passing with semirandom matrices
- Benign Overfitting and Noisy Features
- Fluctuations, bias, variance and ensemble of learners: exact asymptotics for convex losses in high-dimension
- Precise learning curves and higher-order scaling limits for dot-product kernel regression
- Redundant representations help generalization in wide neural networks
- The dynamics of representation learning in shallow, non-linear autoencoders
- Large-dimensional random matrix theory and its applications in deep learning and wireless communications
- Deep networks for system identification: a survey
- A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors
- For interpolating kernel machines, minimizing the norm of the ERM solution maximizes stability
- The curse of overparametrization in adversarial training: precise analysis of robust generalization for random features regression
- On the benefit of width for neural networks: disappearance of basins
- The common intuition to transfer learning can win or lose: case studies for linear regression
- Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation
- The inverse variance-flatness relation in stochastic gradient descent is critical for finding flat minima
- Precise statistical analysis of classification accuracies for adversarial training
- A precise high-dimensional asymptotic theory for boosting and minimum-\(\ell_1\)-norm interpolated classifiers
- Deep learning: a statistical viewpoint
- On the Inconsistency of Kernel Ridgeless Regression in Fixed Dimensions
- scientific article; zbMATH DE number 7625163 (Why is no real title available?)
- Free dynamics of feature learning processes
- Conditioning of random Fourier feature matrices: double descent and generalization error
- High dimensional binary classification under label shift: phase transition and regularization
- A random matrix analysis of random Fourier features: beyond the Gaussian kernel, a precise phase transition, and the corresponding double descent*
- Overparameterization and generalization error: weighted trigonometric interpolation
- Double data piling: a high-dimensional solution for asymptotically perfect multi-category classification
- Stability of the scattering transform for deformations with minimal regularity
- Double Double Descent: On Generalization Errors in Transfer Learning between Linear Regression Tasks
- A phase transition for finding needles in nonlinear haystacks with LASSO artificial neural networks
- The interpolation phase transition in neural networks: memorization and generalization under lazy training
- Theoretical issues in deep networks
- Universality of regularized regression estimators in high dimensions
- SketchySGD: reliable stochastic optimization via randomized curvature estimates
- scientific article; zbMATH DE number 7626737 (Why is no real title available?)
- On the robustness of minimum norm interpolators and regularized empirical risk minimizers
This page was built for publication: The Generalization Error of Random Features Regression: Precise Asymptotics and the Double Descent Curve
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5072044)
