One-step sparse estimates in nonconcave penalized likelihood models

DOI10.1214/009053607000000802zbMath1142.62027arXiv0808.1012OpenAlexW3105034597WikidataQ37381912 ScholiaQ37381912MaRDI QIDQ939649

Hui Zou, Run-Ze Li

Publication date: 28 August 2008

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/0808.1012

zbMATH Keywords

AIC BIC LASSO SCAD oracle properties one-step estimator

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Ridge regression; shrinkage estimators (Lasso) (62J07) Asymptotic properties of nonparametric inference (62G20) Linear regression; mixed models (62J05) Monte Carlo methods (65C05)

Related Items (only showing first 100 items - show all)

Variable selection in quantile varying coefficient models with longitudinal data ⋮ Robust estimation and shrinkage in ultrahigh dimensional expectile regression with heavy tails and variance heterogeneity ⋮ Penalized empirical likelihood inference for sparse additive hazards regression with a diverging number of covariates ⋮ On the strong oracle property of concave penalized estimators with infinite penalty derivative at the origin ⋮ Empirical likelihood and variable selection for partially linear single-index EV models with missing censoring indicators ⋮ Regularization statistical inferences for partially linear models with high dimensional endogenous covariates ⋮ Distributed optimization and statistical learning for large-scale penalized expectile regression ⋮ Bias versus non-convexity in compressed sensing ⋮ Sparse vector Markov switching autoregressive models. Application to multivariate time series of temperature ⋮ Integrative weighted group Lasso and generalized local quadratic approximation ⋮ The use of random-effect models for high-dimensional variable selection problems ⋮ A unifying framework of high-dimensional sparse estimation with difference-of-convex (DC) regularizations ⋮ Robust and efficient direction identification for groupwise additive multiple-index models and its applications ⋮ Balanced estimation for high-dimensional measurement error models ⋮ Moderately clipped Lasso ⋮ Handling multicollinearity in quantile regression through the use of principal component regression ⋮ Support vector machines for unbalanced multicategory classification ⋮ Nonconcave penalized estimation in sparse vector autoregression model ⋮ Estimation and variable selection for quantile partially linear single-index models ⋮ An iterative algorithm for fitting nonconvex penalized generalized linear models with grouped predictors ⋮ Separating variables to accelerate non-convex regularized optimization ⋮ A fast iterative algorithm for high-dimensional differential network ⋮ Bayesian variable selection for mixed effects model with shrinkage prior ⋮ Folded concave penalized sparse linear regression: sparsity, statistical performance, and algorithmic theory for local solutions ⋮ Quantile regression for additive coefficient models in high dimensions ⋮ Variable selection and parameter estimation for partially linear models via Dantzig selector ⋮ Genetic algorithm versus classical methods in sparse index tracking ⋮ Matrix completion with nonconvex regularization: spectral operators and scalable algorithms ⋮ Variable selection and prediction in biased samples with censored outcomes ⋮ Variable selection of varying coefficient models in quantile regression ⋮ Hierarchical Bayes, maximum a posteriori estimators, and minimax concave penalized likelihood estimation ⋮ Asymptotically honest confidence regions for high dimensional parameters by the desparsified conservative Lasso ⋮ Thresholding-based iterative selection procedures for model selection and shrinkage ⋮ Sparse regression with exact clustering ⋮ Majorization-minimization algorithms for nonsmoothly penalized objective functions ⋮ High dimensional classification for spatially dependent data with application to neuroimaging ⋮ A systematic review on model selection in high-dimensional regression ⋮ High-dimensional grouped folded concave penalized estimation via the LLA algorithm ⋮ Penalized quadratic inference function-based variable selection for generalized partially linear varying coefficient models with longitudinal data ⋮ Sparse regression: scalable algorithms and empirical performance ⋮ Variable selection for spatial Poisson point processes via a regularization method ⋮ Variable selection via generalized SELO-penalized Cox regression models ⋮ A distributed one-step estimator ⋮ Portal nodes screening for large scale social networks ⋮ Variable screening for ultrahigh dimensional heterogeneous data via conditional quantile correlations ⋮ Variable selection for spatial semivarying coefficient models ⋮ A cubic spline penalty for sparse approximation under tight frame balanced model ⋮ Distributed one-step upgraded estimation for non-uniformly and non-randomly distributed data ⋮ Convex and non-convex regularization methods for spatial point processes intensity estimation ⋮ Variable selection in the Box-Cox power transformation model ⋮ Pathwise coordinate optimization for sparse learning: algorithm and theory ⋮ Penalized profile least squares-based statistical inference for varying coefficient partially linear errors-in-variables models ⋮ DC programming and DCA: thirty years of developments ⋮ I-LAMM for sparse learning: simultaneous control of algorithmic complexity and statistical error ⋮ Network tail risk estimation in the European banking system ⋮ Robust variable selection for finite mixture regression models ⋮ Gemini: graph estimation with matrix variate normal instances ⋮ A new globally convergent algorithm for non-Lipschitz \(\ell_{p}-\ell_q\) minimization ⋮ A fast algorithm for detecting gene-gene interactions in genome-wide association studies ⋮ Functional response additive model estimation with online virtual stock markets ⋮ A simple and efficient algorithm for fused lasso signal approximator with convex loss function ⋮ An efficient ADMM algorithm for high dimensional precision matrix estimation via penalized quadratic loss ⋮ Local Walsh-average-based estimation and variable selection for single-index models ⋮ Robust and efficient estimator for simultaneous model structure identification and variable selection in generalized partial linear varying coefficient models with longitudinal data ⋮ Partial penalized empirical likelihood ratio test under sparse case ⋮ An improved variable selection procedure for adaptive Lasso in high-dimensional survival analysis ⋮ Bridge regression: adaptivity and group selection ⋮ Efficient and doubly-robust methods for variable selection and parameter estimation in longitudinal data analysis ⋮ Outlier detection under a covariate-adjusted exponential regression model with censored data ⋮ An extended Newton-type algorithm for \(\ell_2\)-regularized sparse logistic regression and its efficiency for classifying large-scale datasets ⋮ Sorted concave penalized regression ⋮ Estimation and optimal structure selection of high-dimensional Toeplitz covariance matrix ⋮ Minimum average variance estimation with group Lasso for the multivariate response central mean subspace ⋮ A unified primal dual active set algorithm for nonconvex sparse recovery ⋮ Necessary and sufficient conditions for variable selection consistency of the Lasso in high dimensions ⋮ The horseshoe-like regularization for feature subset selection ⋮ Quantile regression for functional partially linear model in ultra-high dimensions ⋮ Iteratively reweighted \(\ell_1\)-penalized robust regression ⋮ An outer-inner linearization method for non-convex and nondifferentiable composite regularization problems ⋮ Majorized proximal alternating imputation for regularized rank constrained matrix completion ⋮ Kernel density regression ⋮ Marginal quantile regression for varying coefficient models with longitudinal data ⋮ Penalized kernel quantile regression for varying coefficient models ⋮ Least product relative error estimation for identification in multiplicative additive models ⋮ Nonparametric screening under conditional strictly convex loss for ultrahigh dimensional sparse data ⋮ Sparse classification: a scalable discrete optimization perspective ⋮ Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case ⋮ Estimating the number of components in finite mixture models via the group-sort-fuse procedure ⋮ Analysis of generalized Bregman surrogate algorithms for nonsmooth nonconvex statistical learning ⋮ Generalized high-dimensional trace regression via nuclear norm regularization ⋮ Smoothly adaptively centered ridge estimator ⋮ Marginalized Lasso in sparse regression ⋮ Spatially clustered varying coefficient model ⋮ Order selection for regression-based hidden Markov model ⋮ Group penalized quantile regression ⋮ Variable selection in convex quantile regression: \(\mathcal{L}_1\)-norm or \(\mathcal{L}_0\)-norm regularization? ⋮ Lasso-type penalization in the framework of generalized additive models for location, scale and shape ⋮ Polynomial spline approach for variable selection and estimation in varying coefficient models for time series data ⋮ Scalable estimation and inference for censored quantile regression process ⋮ High-dimensional variable screening through kernel-based conditional mean dependence

Cites Work

This page was built for publication: One-step sparse estimates in nonconcave penalized likelihood models