On the adaptive elastic net with a diverging number of parameters
From MaRDI portal
Publication:2388979
Abstract: We consider the problem of model selection and estimation in situations where the number of parameters diverges with the sample size. When the dimension is high, an ideal method should have the oracle property [J. Amer. Statist. Assoc. 96 (2001) 1348--1360] and [Ann. Statist. 32 (2004) 928--961] which ensures the optimal large sample performance. Furthermore, the high-dimensionality often induces the collinearity problem, which should be properly handled by the ideal method. Many existing variable selection methods fail to achieve both goals simultaneously. In this paper, we propose the adaptive elastic-net that combines the strengths of the quadratic regularization and the adaptively weighted lasso shrinkage. Under weak regularity conditions, we establish the oracle property of the adaptive elastic-net. We show by simulations that the adaptive elastic-net deals with the collinearity problem better than the other oracle-like methods, thus enjoying much improved finite sample performance.
Recommendations
- On the oracle property of a generalized adaptive elastic-net for multivariate linear regression with a diverging number of parameters
- A group adaptive elastic-net approach for variable selection in high-dimensional linear regression
- The adaptive gril estimator with a diverging number of parameters
- Adaptive lasso for generalized linear models with a diverging number of parameters
- Regularization and Variable Selection Via the Elastic Net
Cites work
- Asymptotic behavior of M-estimators of p regression parameters when p^ 2/n is large. I. Consistency
- Asymptotics for Lasso-type estimators.
- Enhancing sparsity by reweighted \(\ell _{1}\) minimization
- Heuristics of instability and stabilization in model selection
- scientific article; zbMATH DE number 739533 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Ideal spatial adaptation by wavelet shrinkage
- Least angle regression. (With discussion)
- Nonconcave penalized likelihood with a diverging number of parameters.
- On the ``degrees of freedom of the lasso
- Profile-kernel likelihood inference with diverging number of parameters
- Regularization and Variable Selection Via the Elastic Net
- Robust regression: Asymptotics, conjectures and Monte Carlo
- Semilinear High-Dimensional Model for Normalization of Microarray Data
- Statistical challenges with high dimensionality: feature selection in knowledge discovery
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Tuning parameter selectors for the smoothly clipped absolute deviation method
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(only showing first 100 items - show all)- Complete subset regressions
- Spatial variable selection and an application to Virginia Lyme disease emergence
- Data mining for longitudinal data under multicollinearity and time dependence using penalized generalized estimating equations
- Model selection consistency of Lasso for empirical data
- Variable selection and parameter estimation with the Atan regularization method
- Robust group identification and variable selection in regression
- The use of random-effect models for high-dimensional variable selection problems
- Balanced estimation for high-dimensional measurement error models
- On the oracle property of a generalized adaptive elastic-net for multivariate linear regression with a diverging number of parameters
- Exponentially tilted likelihood inference on growing dimensional unconditional moment models
- Variable selection and estimation using a continuous approximation to the \(L_0\) penalty
- Generalized F-test for high dimensional regression coefficients of partially linear models
- A group adaptive elastic-net approach for variable selection in high-dimensional linear regression
- Regression adjustment for treatment effect with multicollinearity in high dimensions
- Modified SCAD penalty for constrained variable selection problems
- Nonconvex penalized ridge estimations for partially linear additive models in ultrahigh dimension
- Convex and non-convex regularization methods for spatial point processes intensity estimation
- Robust variable selection for finite mixture regression models
- Model selection via standard error adjusted adaptive Lasso
- Variable selection in linear mixed effects models
- Shrinkage estimation analysis of correlated binary data with a diverging number of parameters
- Regularized k-means clustering of high-dimensional data and its asymptotic consistency
- Majorization-minimization algorithms for nonsmoothly penalized objective functions
- The smooth-Lasso and other \(\ell _{1}+\ell _{2}\)-penalized methods
- Penalized profile least squares-based statistical inference for varying coefficient partially linear errors-in-variables models
- Efficient regularized regression with \(L_0\) penalty for variable selection and network construction
- Double fused Lasso regularized regression with both matrix and vector valued predictors
- Nonnegative estimation and variable selection under minimax concave penalty for sparse high-dimensional linear regression models
- The finite sample properties of sparse M-estimators with pseudo-observations
- Generalization error bounds of dynamic treatment regimes in penalized regression-based learning
- High-dimensional linear regression with hard thresholding regularization: theory and algorithm
- Fast and accurate variational inference for large Bayesian VARs with stochastic volatility
- Regression with adaptive Lasso and correlation based penalty
- Variable selection and collinearity processing for multivariate data via row-elastic-net regularization
- \(\ell_0\)-regularized high-dimensional accelerated failure time model
- On the strong oracle property of concave penalized estimators with infinite penalty derivative at the origin
- Accelerating the distance-minimizing method for data-driven elasticity with adaptive hyperparameters
- Regularization-based bootstrap ranking model: identifying healthcare indicators among all level income economies
- A generalized bridge regression in fuzzy environment and its numerical solution by a capable recurrent neural network
- Hierarchically penalized additive hazards model with diverging number of parameters
- Sparse and efficient estimation for partial spline models with increasing dimension
- Group identification and variable selection in quantile regression
- An improved variable selection procedure for adaptive Lasso in high-dimensional survival analysis
- Bridge regression: adaptivity and group selection
- Robust elastic net estimators for variable selection and identification of proteomic biomarkers
- Variable selection with spatially autoregressive errors: a generalized moments Lasso estimator
- Asymptotic theory of the adaptive sparse group Lasso
- Informative gene selection for microarray classification via adaptive elastic net with conditional mutual information
- Adaptive-to-model checking for regressions with diverging number of predictors
- Adaptive fused LASSO in grouped quantile regression
- A consistent and numerically efficient variable selection method for sparse Poisson regression with applications to learning and signal recovery
- On Hodges' superefficiency and merits of oracle property in model selection
- Stable prediction in high-dimensional linear models
- An exact approach to ridge regression for big data
- Model-free feature screening via a modified composite quantile correlation
- Consistent tuning parameter selection in high-dimensional group-penalized regression
- GEE analysis of clustered binary data with diverging number of covariates
- Variable selection via combined penalization for high-dimensional data analysis
- Model averaging with covariates that are missing completely at random
- Endogeneity in high dimensions
- Some properties of generalized fused Lasso and its applications to high dimensional data
- On the oracle property of adaptive group Lasso in high-dimensional linear models
- Adaptive group Lasso selection in quantile models
- Smooth LASSO estimator for the function-on-function linear regression model
- Envelope-based sparse reduced-rank regression for multivariate linear model
- Penalized empirical likelihood for high-dimensional partially linear varying coefficient model with measurement errors
- Nonnegative adaptive Lasso for ultra-high dimensional regression models and a two-stage method applied in financial modeling
- Robust variable selection in semiparametric mean-covariance regression for longitudinal data analysis
- Variable selection in linear mixed models using an extended class of penalties
- Bridge estimation for linear regression models with mixing properties
- Quadratic approximation via the SCAD penalty with a diverging number of parameters
- Bayesian elastic net Tobit quantile regression
- The adaptive BerHu penalty in robust regression
- Variable selection and estimation in generalized linear models with the seamless L₀ penalty
- The adaptive gril estimator with a diverging number of parameters
- Group variable selection with oracle property by weight-fused adaptive elastic net model for strongly correlated data
- Bridge Estimators in the Partially Linear Model with High Dimensionality
- Grouping Variable Selection by Weight Fused Elastic Net for Multi-Collinear Data
- Shrinkage tuning parameter selection with a diverging number of parameters
- Variable selection for survival data with a class of adaptive elastic net techniques
- Robust variable selection for generalized linear models with a diverging number of parameters
- Applications of adaptive elastic net procedure for logistic regression model
- Combined-penalized likelihood estimations with a diverging number of parameters
- Fast and scalable Lasso via stochastic Frank-Wolfe methods with a convergence guarantee
- SCAD-penalized least absolute deviation regression in high-dimensional models
- Weighted elastic net penalized mean-variance portfolio design and computation
- On model selection consistency of the elastic net when p n
- Two-step adaptive model selection for vector autoregressive processes
- Manifold elastic net: a unified framework for sparse dimension reduction
- Profiled adaptive elastic-net procedure for partially linear models with high-dimensional covar\-i\-ates
- Quadratic approximation for nonconvex penalized estimations with a diverging number of parameters
- Sparsity constrained estimation in image processing and computer vision
- Testing for Neglected Nonlinearity Using Regularized Artificial Neural Networks
- Cluster feature selection in high-dimensional linear models
- Greedy forward regression for variable screening
- Feature screening via distance correlation learning
- SCAD penalized rank regression with a diverging number of parameters
- Robust smooth-threshold estimating equations for generalized varying-coefficient partially linear models based on exponential score function
- Sparse reduced-rank regression for simultaneous dimension reduction and variable selection
- Two tales of variable selection for high dimensional regression: Screening and model building
This page was built for publication: On the adaptive elastic net with a diverging number of parameters
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2388979)
