Analysis of overfitting in the regularized Cox model
From MaRDI portal
Publication:5059054
Abstract: The Cox proportional hazards model is ubiquitous in the analysis of time-to-event data. However, when the data dimension p is comparable to the sample size , maximum likelihood estimates for its regression parameters are known to be biased or break down entirely due to overfitting. This prompted the introduction of the so-called regularized Cox model. In this paper we use the replica method from statistical physics to investigate the relationship between the true and inferred regression parameters in regularized multivariate Cox regression with L2 regularization, in the regime where both p and N are large but with p/N ~ O(1). We thereby generalize a recent study from maximum likelihood to maximum a posteriori inference. We also establish a relationship between the optimal regularization parameter and p/N, allowing for straightforward overfitting corrections in time-to-event analysis.
Recommendations
- Replica analysis of overfitting in regression models for time-to-event data
- Replica analysis of overfitting in generalized linear regression models
- Regularization for Cox's proportional hazards model with NP-dimensionality
- Bridging data exploration and modeling in event-history analysis: the supervised-component Cox regression
- Supervised-component based Cox regression
Cites work
- A modern maximum-likelihood theory for high-dimensional logistic regression
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- A spin Glass model for reconstructing nonlinearly encrypted signals corrupted by noise
- Bias reduction of maximum likelihood estimates
- Collinearity and least squares regression
- scientific article; zbMATH DE number 469130 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 3244317 (Why is no real title available?)
- scientific article; zbMATH DE number 3385132 (Why is no real title available?)
- Large numbers of explanatory variables: a probabilistic assessment
- Logistic Discrimination and Bias Correction in Maximum Likelihood Estimation
- Nonuniformity of p-values can occur early in diverging dimensions
- On the complexity of logistic regression models
- Penalized partial likelihood regression for right-censored data with bootstrap selection of the penalty parameter
- Replica analysis of overfitting in regression models for time-to-event data
- Risk minimization through portfolio replication
- Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- Tuning parameter selection in high dimensional penalized likelihood
Cited in
(6)- Bridging data exploration and modeling in event-history analysis: the supervised-component Cox regression
- Replica analysis of overfitting in regression models for time-to-event data
- Replica analysis of overfitting in generalized linear regression models
- Penalization-induced shrinking without rotation in high dimensional GLM regression: a cavity analysis
- Replica analysis of overfitting in regression models for time to event data: the impact of censoring
- Observable asymptotics of regularized Cox regression models with standard Gaussian designs: a statistical mechanics approach
This page was built for publication: Analysis of overfitting in the regularized Cox model
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5059054)
