A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
From MaRDI portal
(Redirected from Publication:3405559)
Abstract: High dimensional statistical problems arise from diverse fields of scientific research and technological development. Variable selection plays a pivotal role in contemporary statistical learning and scientific discoveries. The traditional idea of best subset selection methods, which can be regarded as a specific form of penalized likelihood, is computationally too expensive for many modern statistical applications. Other forms of penalized likelihood methods have been successfully developed over the last decade to cope with high dimensionality. They have been widely applied for simultaneously selecting important variables and estimating their effects in high dimensional statistical inference. In this article, we present a brief account of the recent developments of theory, methods, and implementations for high dimensional variable selection. What limits of the dimensionality such methods can handle, what the role of penalty functions is, and what the statistical properties are rapidly drive the advances of the field. The properties of non-concave penalized likelihood and its roles in high dimensional statistical modeling are emphasized. We also review some recent advances in ultra-high dimensional variable selection, with emphasis on independence screening and two-scale methods.
Recommendations
- Variable selection in high dimensional data analysis with applications
- High-dimensional variable selection
- Variable selection for high dimensional multivariate outcomes
- Variable selection in high-dimensional partially linear models
- Variable selection methods in high-dimensional regression -- a simulation study
- Selection of variables and dimension reduction in high-dimensional non-parametric regression
- Feature selection for high-dimensional data
- Variable selection for support vector machines in moderately high dimensions
- A semi-parametric approach to feature selection in high-dimensional linear regression models
- Variable selection in multivariate linear models with high-dimensional covariance matrix estimation
Cited in
(only showing first 100 items - show all)- Leveraging mixed and incomplete outcomes via reduced-rank modeling
- Model-based boosting in R: a hands-on tutorial using the R package mboost
- Bayesian variable selection with shrinking and diffusing priors
- Spatial variable selection and an application to Virginia Lyme disease emergence
- An MM Algorithm for Split Feasibility Problems
- Penalized likelihood and Bayesian function selection in regression models
- On selecting interacting features from high-dimensional data
- LOL selection in high dimension
- Big data Bayesian linear regression and variable selection by normal-inverse-gamma summation
- Variable selection via generalized SELO-penalized linear regression models
- A moment-distance hybrid method for estimating a mixture of two symmetric densities
- Nonparametric independence screening via favored smoothing bandwidth
- Are discoveries spurious? Distributions of maximum spurious correlations and their applications
- Self-normalization: taming a wild population in a heavy-tailed world
- Simultaneous dimension reduction and variable selection in modeling high dimensional data
- Variable selection using shrinkage priors
- Balanced estimation for high-dimensional measurement error models
- Studies of the adaptive network-constrained linear regression and its application
- B spline variable selection for the single index models
- Variable selection and prediction in biased samples with censored outcomes
- Asymptotically honest confidence regions for high dimensional parameters by the desparsified conservative Lasso
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- A systematic review on model selection in high-dimensional regression
- Adaptive testing for the partially linear single-index model with error-prone linear covariates
- An RKHS model for variable selection in functional linear regression
- Variable selection via generalized SELO-penalized Cox regression models
- Weighted-average least squares estimation of generalized linear models
- Variable screening for high dimensional time series
- Convex and non-convex regularization methods for spatial point processes intensity estimation
- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- An RKHS-based approach to double-penalized regression in high-dimensional partially linear models
- Bridge estimation for generalized linear models with a diverging number of parameters
- A method for selecting the relevant dimensions for high-dimensional classification in singular vector spaces
- Spline estimator for ultra-high dimensional partially linear varying coefficient models
- Variational nonparametric discriminant analysis
- Inference under Fine-Gray competing risks model with high-dimensional covariates
- Partial penalized empirical likelihood ratio test under sparse case
- A distribution-based Lasso for a general single-index model
- Quantile regression under local misspecification
- Kick-one-out-based variable selection method for Euclidean distance-based classifier in high-dimensional settings
- Clustering of subsample means based on pairwise L1 regularized empirical likelihood
- Penalized kernel quantile regression for varying coefficient models
- Variable selection in functional regression models: a review
- Sure independence screening in the presence of missing data
- High-dimensional inference for linear model with correlated errors
- Bayesian factor-adjusted sparse regression
- Poisson autoregressive process modeling via the penalized conditional maximum likelihood procedure
- Asymptotics of estimators for nonparametric multivariate regression models with long memory
- Rescorla-Wagner models with sparse dynamic attention
- Relevant parameter changes in structural break models
- Variational discriminant analysis with variable selection
- Sparsity-regularized skewness estimation for the multivariate skew normal and multivariate skew \(t\) distributions
- High-dimensional predictive regression in the presence of cointegration
- Truncated pair-wise likelihood for the Brown-Resnick process with applications to maximum temperature data
- Penalized empirical likelihood for partially linear errors-in-variables models
- A clustering-based feature selection method for automatically generated relational attributes
- Variable selection in the Box-Cox power transformation model
- Efficient reconstructions of Common Era climate via integrated nested Laplace approximations
- Variable selection via adaptive false negative control in linear regression
- Robust finite mixture regression for heterogeneous targets
- High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking
- Error density estimation in high-dimensional sparse linear model
- Pseudo estimation and variable selection in regression
- False discovery control for penalized variable selections with high-dimensional covariates
- Linear hypothesis testing for high dimensional generalized linear models
- Nonparametric additive beta regression for fractional response with application to body fat data
- Subjective Bayesian testing using calibrated prior probabilities
- A new test for part of high dimensional regression coefficients
- Penalized variable selection in competing risks regression
- Bayesian sparse reduced rank multivariate regression
- Variable selection in joint location, scale and skewness models of the skew-normal distribution
- Generalized canonical correlation variables improved estimation in high dimensional seemingly unrelated regression models
- Sparse wavelet estimation in quantile regression with multiple functional predictors
- Comparison of deep neural networks and deep hierarchical models for spatio-temporal data
- Optimal estimation of direction in regression models with large number of parameters
- Some improved estimation strategies in high-dimensional semiparametric regression models with application to riboflavin production data
- GEE analysis of clustered binary data with diverging number of covariates
- Ultrahigh dimensional variable selection through the penalized maximum trimmed likelihood estimator
- Variable selection via combined penalization for high-dimensional data analysis
- Model selection in linear mixed models
- ``Virus hunting using radial distance weighted discrimination
- BFLCRM: a Bayesian functional linear Cox regression model for predicting time to conversion to Alzheimer's disease
- Model structure selection in single-index-coefficient regression models
- Concordance and value information criteria for optimal treatment decision
- Asymptotics of AIC, BIC and \(C_p\) model selection rules in high-dimensional regression
- Penalized regression for interval-censored times of disease progression: selection of HLA markers in psoriatic arthritis
- Local independence feature screening for nonparametric and semiparametric models by marginal empirical likelihood
- Regularization in finite mixture of regression models with diverging number of parameters
- Parallelism, uniqueness, and large-sample asymptotics for the Dantzig selector
- Variable selection in large margin classifier-based probability estimation with high-dimensional predictors
- An overview of the new feature selection methods in finite mixture of regression models
- Effect of heavy tails on ultra high dimensional variable ranking methods
- Laplace error penalty-based variable selection in high dimension
- Designing penalty functions in high dimensional problems: the role of tuning parameters
- A rank-corrected procedure for matrix completion with fixed basis coefficients
- RANK: Large-Scale Inference With Graphical Nonlinear Knockoffs
- L2RM: Low-Rank Linear Regression Models for High-Dimensional Matrix Responses
- PBoostGA: pseudo-boosting genetic algorithm for variable ranking and selection
- Particle swarm stepwise (PaSS) algorithm for information criteria-based variable selections
- Meta-analysis based variable selection for gene expression data
This page was built for publication: A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3405559)
