AgFlow: fast model selection of penalized PCA via implicit regularization effects of gradient flow

DOI10.1007/s10994-021-06025-3MaRDI QIDQ2071349

Dongrui Wu, Dejing Dou, Ji Liu, Haiyan Jiang, Haoyi Xiong

Publication date: 28 January 2022

Published in: Machine Learning (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2110.03273

zbMATH Keywords

ridge; model selection; gradient flow; implicit regularization; penalized PCA

Mathematics Subject Classification ID

68T05: Learning and adaptive systems in artificial intelligence

Uses Software

• glmnet
• ElemStatLearn
• scout
• PMA
• LFW

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis
• On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix
• Human face recognition based on multidimensional PCA and extreme learning machine
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• Markov blanket-embedded genetic algorithm for gene selection
• Covariance-Regularized Regression and Classification for high Dimensional Problems
• Numerical methods for experimental design of large-scale linear ill-posed inverse problems
• Ridge regression:some simulations
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Regularization and Variable Selection Via the Elastic Net
• Model Selection and Estimation in Regression with Grouped Variables
• Ridge Regression: Biased Estimation for Nonorthogonal Problems