Variance estimation using refitted cross-validation in ultrahigh dimensional regression
From MaRDI portal
Abstract: Variance estimation is a fundamental problem in statistical modeling. In ultrahigh dimensional linear regressions where the dimensionality is much larger than sample size, traditional variance estimation techniques are not applicable. Recent advances on variable selection in ultrahigh dimensional linear regressions make this problem accessible. One of the major problems in ultrahigh dimensional regression is the high spurious correlation between the unobserved realized noise and some of the predictors. As a result, the realized noises are actually predicted when extra irrelevant variables are selected, leading to serious underestimate of the noise level. In this paper, we propose a two-stage refitted procedure via a data splitting technique, called refitted cross-validation (RCV), to attenuate the influence of irrelevant variables with high spurious correlations. Our asymptotic results show that the resulting procedure performs as well as the oracle estimator, which knows in advance the mean regression function. The simulation studies lend further support to our theoretical claims. The naive two-stage estimator which fits the selected variables in the first stage and the plug-in one stage estimators using LASSO and SCAD are also studied and compared. Their performances can be improved by the proposed RCV method.
Recommendations
- Variance estimation based on blocked 3 2 cross-validation in high-dimensional linear regression
- Error variance estimation in ultrahigh-dimensional additive models
- Test for high-dimensional regression coefficients using refitted cross-validation variance estimation
- scientific article; zbMATH DE number 1471718
- Variance estimation in high-dimensional linear models
Cited in
(only showing first 100 items - show all)- Conditional dependence learning with high-dimensional conditioning variables
- New Tests for High-Dimensional Linear Regression Based on Random Projection
- Robust \(U\)-type test for high dimensional regression coefficients using refitted cross-validation variance estimation
- Tests for high-dimensional single-index models
- Semiparametric inference based on adaptively collected data
- Adaptive estimation of high-dimensional signal-to-noise ratios
- Are discoveries spurious? Distributions of maximum spurious correlations and their applications
- A study on tuning parameter selection for the high-dimensional lasso
- A new approach for ultrahigh dimensional precision matrix estimation
- Nonparametric Quantile Regression Estimation With Mixed Discrete and Continuous Data
- Cox reduction and confidence sets of models: a theoretical elucidation
- Two-sample testing of high-dimensional linear regression coefficients via complementary sketching
- Generalized k-means in GLMs with applications to the outbreak of COVID-19 in the United States
- High dimensional regression with many nuisance parameters: both cases of specified and unspecified parameters of interest
- Are Latent Factor Regression and Sparse Regression Adequate?
- Bayesian L 1/2 Regression
- Integrative Factor Regression and Its Inference for Multimodal Data Analysis
- Test and Measure for Partial Mean Dependence Based on Machine Learning Methods
- Noise covariance estimation in multi-task high-dimensional linear models
- A Random Projection Approach to Hypothesis Tests in High-Dimensional Single-Index Models
- Variance estimation for sparse ultra-high dimensional varying coefficient models
- Robust error density estimation in ultrahigh dimensional sparse linear model
- Robust variable selection and estimation via adaptive elastic net S-estimators for linear regression
- Ultrahigh dimensional single index model estimation via refitted cross-validation
- Markov Neighborhood Regression for High-Dimensional Inference
- Asymptotically optimal differenced estimators of error variance in nonparametric regression
- A generalized knockoff procedure for FDR control in structural change detection
- A post-screening diagnostic study for ultrahigh dimensional data
- Reprint: Hypothesis testing on high dimensional quantile regression
- Hypothesis testing on high dimensional quantile regression
- Variance estimation for semiparametric regression models by local averaging
- Distributed testing and estimation under sparse high dimensional models
- Error density estimation in high-dimensional sparse linear model
- Greedy variance estimation for the LASSO
- Testing the Linear Mean and Constant Variance Conditions in Sufficient Dimension Reduction
- Tests for high-dimensional partially linear regression models
- Statistical Inference for High-Dimensional Models via Recursive Online-Score Estimation
- Inference for possibly misspecified generalized linear models with nonpolynomial-dimensional nuisance parameters
- Testing for high-dimensional network parameters in auto-regressive models
- A tuning-free robust and efficient approach to high-dimensional regression
- Cross-Fitted Residual Regression for High-Dimensional Heteroscedasticity Pursuit
- RCV-based error density estimation in the ultrahigh dimensional additive model
- Activation discovery with FDR control: application to fMRI data
- The use of vector bootstrapping to improve variable selection precision in Lasso models
- Variance-estimation-free test of significant covariates in high-dimensional regression
- Feature screening and error variance estimation for ultrahigh-dimensional linear model with measurement errors
- Test for high dimensional regression coefficients of partially linear models
- L0-Regularized Learning for High-Dimensional Additive Hazards Regression
- A Critical Review of LASSO and Its Derivatives for Variable Selection Under Dependence Among Covariates
- A zero-estimator approach for estimating the signal level in a high-dimensional model-free setting
- Variance estimation based on blocked 3 2 cross-validation in high-dimensional linear regression
- Penalized weighted composite quantile regression in the linear regression model with heavy-tailed autocorrelated errors
- A Goodness-of-Fit Assessment for General Learning Procedures in High Dimensions
- Variance estimation in high-dimensional linear regression via adaptive elastic-net
- A new approach for ultrahigh-dimensional covariance matrix estimation
- RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs
- Robust semiparametric gene-environment interaction analysis using sparse boosting
- Semi-supervised inference for the high-dimensional quantile regression
- scientific article; zbMATH DE number 7370619 (Why is no real title available?)
- Inference without compatibility: using exponential weighting for inference on a parameter of a linear model
- Estimations and Tests for Generalized Mediation Models with High-Dimensional Potential Mediators
- Using History Matching for Prior Choice
- Inference in models with omitted covariates: Cramér-type moderate deviations and applications to high-dimensional regression
- Model selection criteria for a linear model to solve discrete ill-posed problems on the basis of singular decomposition and random projection
- Nonsparse learning with latent variables
- Improved estimators for semi-supervised high-dimensional regression model
- Feature Screening with Latent Responses
- Inference for partially linear quantile regression models in ultrahigh dimension
- Model Selection With Lasso-Zero: Adding Straw to the Haystack to Better Find Needles
- Ensemble testing for high-dimensional multiple response models
- In defense of the indefensible: a very naïve approach to high-dimensional inference
- Regularized projection score estimation of treatment effects in high-dimensional quantile regression
- Test for high-dimensional regression coefficients using refitted cross-validation variance estimation
- Moderate-Dimensional Inferences on Quadratic Functionals in Ordinary Least Squares
- Feature selection for generalized varying coefficient mixed-effect models with application to obesity GWAS
- Ultrahigh dimensional precision matrix estimation via refitted cross validation
- Linear hypothesis testing for high dimensional generalized linear models
- Distributed learning for high-dimensional factor augmented regression models
- Robust weighted transfer learning with linear constraints under linear regressive model
- Partitioned Approach for High-dimensional Confidence Intervals with Large Split Sizes
- High-Dimensional Expected Shortfall Regression
- Higher Order Accurate Symmetric Bootstrap Confidence Intervals in High Dimensional Penalized Regression
- Testing regression coefficients in high-dimensional and sparse settings
- Error variance estimation in ultrahigh-dimensional additive models
- Reproducible learning in large-scale graphical models
- Neighborhood-based cross fitting approach to treatment effects with high-dimensional data
- Extended differential geometric LARS for high-dimensional GLMs with general dispersion parameter
- Conditional Test for Ultrahigh Dimensional Linear Regression Coefficients
- Threshold Selection in Feature Screening for Error Rate Control
- A new nonparametric test for high-dimensional regression coefficients
- Variance estimation of a general u-statistic with appllication to cross-validation
- Block-regularized \(m\times 2\) cross-validated estimator of the generalization error
- Statistical inference for matrix-vector linear regression without debiasing under Kronecker covariance structure
- Most powerful test against a sequence of high dimensional local alternatives
- Fiducial selector: fast and efficient inference for high-dimensional regression
- Densely connected sub-Gaussian linear structural equation model learning via \(\ell_1\)- and \(\ell_2\)-regularized regressions
- Quantification of model bias underlying the phenomenon of Einstein from Noise
- A simple method to improve principal components regression
- Sparse spatio-temporal autoregressions by profiling and bagging
- Debiased Inference on Treatment Effect in a High-Dimensional Model
This page was built for publication: Variance estimation using refitted cross-validation in ultrahigh dimensional regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4632664)
