SparseNet: Coordinate Descent With Nonconvex Penalties

DOI10.1198/JASA.2011.TM09738zbMath1229.62091OpenAlexW1965169081WikidataQ34857620 ScholiaQ34857620MaRDI QIDQ3111203

Rahul Mazumder, Trevor Hastie, Jerome H. Friedman

Publication date: 18 January 2012

Published in: Journal of the American Statistical Association (Search for Journal in Brave)

Full work available at URL: http://europepmc.org/articles/pmc4286300

zbMATH Keywords

nonconvex optimizationvariable selectionsparse regressionLASSOdegrees of freedomregularization surface

Mathematics Subject Classification ID

Linear regression; mixed models (62J05) Applications of mathematical programming (90C90) Nonconvex programming, global optimization (90C26)

Related Items (only showing first 100 items - show all)

Compound Poisson processes, latent shrinkage priors and Bayesian nonconvex penalization ⋮ Sparse Laplacian shrinkage with the graphical Lasso estimator for regression problems ⋮ Tuning parameter selection in sparse regression modeling ⋮ Global solutions to folded concave penalized nonconvex learning ⋮ Best subset selection via a modern optimization lens ⋮ Solving norm constrained portfolio optimization via coordinate-wise descent algorithms ⋮ Estimation of an oblique structure via penalized likelihood factor analysis ⋮ On the strong oracle property of concave penalized estimators with infinite penalty derivative at the origin ⋮ Sparsest factor analysis for clustering variables: a matrix decomposition approach ⋮ An alternating direction method of multipliers for MCP-penalized regression with high-dimensional data ⋮ Designing penalty functions in high dimensional problems: the role of tuning parameters ⋮ Variable selection via generalized SELO-penalized linear regression models ⋮ An Alternating Method for Cardinality-Constrained Optimization: A Computational Study for the Best Subset Selection and Sparse Portfolio Problems ⋮ Bias versus non-convexity in compressed sensing ⋮ The Spike-and-Slab LASSO ⋮ False Discovery Rate Smoothing ⋮ A unifying framework of high-dimensional sparse estimation with difference-of-convex (DC) regularizations ⋮ Regularized quantile regression under heterogeneous sparsity with application to quantitative genetic traits ⋮ Nonconvex regularization for sparse neural networks ⋮ Dimension-reduced clustering of functional data via subspace separation ⋮ Linear Time Dynamic Programming for Computing Breakpoints in the Regularization Path of Models Selected From a Finite Set ⋮ Bayesian bridge quantile regression ⋮ Relaxed sparse eigenvalue conditions for sparse estimation via non-convex regularized regression ⋮ Robust alternating low-rank representation by joint \(L_p\)- and \(L_{2,p}\)-norm minimization ⋮ Computing the degrees of freedom of rank-regularized estimators and cousins ⋮ Separating variables to accelerate non-convex regularized optimization ⋮ Adjusted regularized estimation in the accelerated failure time model with high dimensional covariates ⋮ AIC for the non-concave penalized likelihood method ⋮ Parametrized quasi-soft thresholding operator for compressed sensing and matrix completion ⋮ Transformed \(\ell_1\) regularization for learning sparse deep neural networks ⋮ Difference-of-Convex Learning: Directional Stationarity, Optimality, and Sparsity ⋮ Efficient nonconvex sparse group feature selection via continuous and discrete optimization ⋮ A primal dual active set with continuation algorithm for high-dimensional nonconvex SICA-penalized regression ⋮ Large-scale regression with non-convex loss and penalty ⋮ Unnamed Item ⋮ Genetic algorithm versus classical methods in sparse index tracking ⋮ Matrix completion with nonconvex regularization: spectral operators and scalable algorithms ⋮ A penalized likelihood method for structural equation modeling ⋮ Homotopy continuation approaches for robust SV classification and regression ⋮ A coordinate descent algorithm for computing penalized smooth quantile regression ⋮ Hierarchical Bayes, maximum a posteriori estimators, and minimax concave penalized likelihood estimation ⋮ A majorization-minimization approach to variable selection using spike and slab priors ⋮ Majorization-minimization algorithms for nonsmoothly penalized objective functions ⋮ Confidence Intervals for Sparse Penalized Regression With Random Designs ⋮ Solution path clustering with adaptive concave penalty ⋮ Independently Interpretable Lasso for Generalized Linear Models ⋮ The sparse Laplacian shrinkage estimator for high-dimensional regression ⋮ An unbiased approach to compressed sensing ⋮ Worst-case complexity of cyclic coordinate descent: \(O(n^2)\) gap with randomized version ⋮ Best subset, forward stepwise or Lasso? Analysis and recommendations based on extensive comparisons ⋮ A discussion on practical considerations with sparse regression methodologies ⋮ Rejoinder: ``Best subset, forward stepwise or Lasso? Analysis and recommendations based on extensive comparisons ⋮ SICA for Cox's proportional hazards model with a diverging number of parameters ⋮ The variational Garrote ⋮ Optimal computational and statistical rates of convergence for sparse nonconvex learning problems ⋮ Variable selection via generalized SELO-penalized Cox regression models ⋮ A fresh look at effect aliasing and interactions: some new wine in old bottles ⋮ Convex and non-convex regularization methods for spatial point processes intensity estimation ⋮ Pathwise coordinate optimization for sparse learning: algorithm and theory ⋮ Minimization of transformed \(L_1\) penalty: theory, difference of convex function algorithm, and robust application in compressed sensing ⋮ GAITA: a Gauss-Seidel iterative thresholding algorithm for \(\ell_q\) regularized least squares regression ⋮ On Faster Convergence of Cyclic Block Coordinate Descent-type Methods for Strongly Convex Minimization ⋮ Quantile Regression for Analyzing Heterogeneity in Ultra-High Dimension ⋮ High-Dimensional Sparse Additive Hazards Regression ⋮ Efficient regularized regression with \(L_0\) penalty for variable selection and network construction ⋮ Unnamed Item ⋮ Sparse factor regression via penalized maximum likelihood estimation ⋮ Prediction risk for the horseshoe regression ⋮ Strong oracle optimality of folded concave penalized estimation ⋮ A unified primal dual active set algorithm for nonconvex sparse recovery ⋮ Variance prior forms for high-dimensional Bayesian variable selection ⋮ The horseshoe-like regularization for feature subset selection ⋮ PenPC : A two-step approach to estimate the skeletons of high-dimensional directed acyclic graphs ⋮ ROS regression: integrating regularization with optimal scaling regression ⋮ Lasso meets horseshoe: a survey ⋮ OR Forum—An Algorithmic Approach to Linear Regression ⋮ An ADMM with continuation algorithm for non-convex SICA-penalized regression in high dimensions ⋮ An outer-inner linearization method for non-convex and nondifferentiable composite regularization problems ⋮ Majorization minimization by coordinate descent for concave penalized generalized linear models ⋮ Regularization methods for high-dimensional sparse control function models ⋮ A Generalized Least-Square Matrix Decomposition ⋮ Model Selection via Bayesian Information Criterion for Quantile Regression Models ⋮ Testing Sparsity-Inducing Penalties ⋮ sparsenet ⋮ cmenet: A New Method for Bi-Level Variable Selection of Conditional Main Effects ⋮ Sparse classification: a scalable discrete optimization perspective ⋮ Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case ⋮ Smoothing Newton method for \(\ell^0\)-\(\ell^2\) regularized linear inverse problem ⋮ New bounds for subset selection from conic relaxations ⋮ Mining events with declassified diplomatic documents ⋮ Marginalized Lasso in sparse regression ⋮ Fast Best Subset Selection: Coordinate Descent and Local Combinatorial Optimization Algorithms ⋮ Nonbifurcating Phylogenetic Tree Inference via the Adaptive LASSO ⋮ Novel harmonic regularization approach for variable selection in Cox's proportional hazards model ⋮ Unnamed Item ⋮ Sparse regression at scale: branch-and-bound rooted in first-order optimization ⋮ A non-convex regularization approach for stable estimation of loss development factors ⋮ Convex optimization under combinatorial sparsity constraints ⋮ Coordinate descent algorithms ⋮ Sparse estimation via nonconcave penalized likelihood in factor analysis model

This page was built for publication: SparseNet: Coordinate Descent With Nonconvex Penalties