Replica analysis of overfitting in generalized linear regression models

DOI10.1088/1751-8121/aba028OpenAlexW3037131441MaRDI QIDQ5870629

Mansoor Sheikh, Alexander Mozeika, F. Aguirre-Lopez, F. Antenucci, A. C. C. Coolen

Publication date: 23 January 2023

Published in: Journal of Physics A: Mathematical and Theoretical (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2004.06329

zbMATH Keywords

replica methodregressiongeneralized linear modelsoverfitting

Mathematics Subject Classification ID

Quantum theory (81-XX) Statistical mechanics, structure of matter (82-XX)

Related Items

Penalization-induced shrinking without rotation in high dimensional GLM regression: a cavity analysis

Cites Work

• Computing the nearest correlation matrix--a problem from finance
• An iterative construction of solutions of the TAP equations for the Sherrington-Kirkpatrick model
• Spectrum estimation for large dimensional covariance matrices using random matrix theory
• Approximation by matrices positive semidefinite on a subspace
• Analysis of multivariate survival data
• Survival analysis. Techniques for censored and truncated data.
• Broken replica symmetry bounds in the mean field spin glass model
• The likelihood ratio test in high-dimensional logistic regression is asymptotically a rescaled Chi-square
• The adaptive interpolation method: a simple scheme to prove replica formulas in Bayesian inference
• Universality in polytope phase transitions and message passing algorithms
• Infinitely imbalanced binomial regression and deformed exponential families
• Mathematical properties of the multivariate \(t\) distribution
• Analysis of Regularized LS Reconstruction and Random Matrix Ensembles in Compressed Sensing
• Inference for Generalized Linear Models via Alternating Directions and Bethe Free Energy Minimization
• THE SAMPLING DISTRIBUTION OF A MAXIMUM-LIKELIHOOD ESTIMATE
• NOTES ON BIAS IN ESTIMATION
• Typicall₁-recovery limit of sparse vectors represented by concatenations of random orthogonal matrices
• Randomly Spread CDMA: Asymptotics Via Statistical Physics
• Logistic Discrimination and Bias Correction in Maximum Likelihood Estimation
• Expectation-Maximization Gaussian-Mixture Approximate Message Passing
• Bias reduction of maximum likelihood estimates
• Spectral efficiency of CDMA with random spreading
• Linear multiuser receivers: effective interference, effective bandwidth and user capacity
• Bayesian analysis of outlier problems using divergence measures
• Approximate survey propagation for statistical inference
• Analysis of overfitting in the regularized Cox model
• On the Convergence of Approximate Message Passing With Arbitrary Matrices
• Vector Approximate Message Passing
• Statistical Mechanics of MAP Estimation: General Replica Ansatz
• A modern maximum-likelihood theory for high-dimensional logistic regression
• Optimal errors and phase transitions in high-dimensional generalized linear models
• Asymptotic Analysis of MAP Estimation via the Replica Method and Applications to Compressed Sensing
• The Dynamics of Message Passing on Dense Graphs, with Applications to Compressed Sensing
• Replica analysis of overfitting in regression models for time-to-event data
• The space of interactions in neural network models
• APPROXIMATE CONFIDENCE INTERVALS
• APPROXIMATE CONFIDENCE INTERVALS
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item