The Group Lasso for Logistic Regression

DOI10.1111/j.1467-9868.2007.00627.xzbMath1400.62276OpenAlexW2106398669MaRDI QIDQ3631444

Lukas Meier, Sara van de Geer, Peter Bühlmann

Publication date: 10 June 2009

Published in: Journal of the Royal Statistical Society Series B: Statistical Methodology (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1111/j.1467-9868.2007.00627.x

zbMATH Keywords

penalized likelihoodcategorical datagroup variable selectionco-ordinate descent algorithmDNA splice sitehigh dimensional generalized linear model

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10)

Related Items

Duality of nonconvex optimization with positively homogeneous functions, Penalized likelihood and Bayesian function selection in regression models, Sparse group Lasso and high dimensional multinomial classification, Group variable selection for relative error regression, Nonparametric additive model with grouped Lasso and maximizing area under the ROC curve, Variable and boundary selection for functional data via multiclass logistic regression modeling, Variable selection in general multinomial logit models, Hybrid safe-strong rules for efficient optimization in Lasso-type problems, Conditional score matching for high-dimensional partial graphical models, Split Bregman algorithms for sparse group lasso with application to MRI reconstruction, Block coordinate proximal gradient methods with variable Bregman functions for nonsmooth separable optimization, Sparse approximate solution of fitting surface to scattered points by MLASSO model, Structured variable selection via prior-induced hierarchical penalty functions, Wavelet-based scalar-on-function finite mixture regression models, Robust groupwise least angle regression, Bayesian quantile regression using the skew exponential power distribution, Studies of the adaptive network-constrained linear regression and its application, Grouped variable importance with random forests and application to multiple functional data analysis, Fast learning rate of multiple kernel learning: trade-off between sparsity and smoothness, On group-wise \(\ell_p\) regularization: theory and efficient algorithms, A unified approach to error bounds for structured convex optimization problems, Approximation accuracy, gradient methods, and error bound for structured convex optimization, Identification of breast cancer prognosis markers via integrative analysis, Grouping strategies and thresholding for high dimensional linear models, Block coordinate descent algorithms for large-scale sparse multiclass classification, An adaptive partial linearization method for optimization problems on product sets, \(\ell_{1}\)-penalization for mixture regression models, Efficient nonconvex sparse group feature selection via continuous and discrete optimization, Variable selection for generalized linear mixed models by \(L_1\)-penalized estimation, Sparse and low-rank matrix regularization for learning time-varying Markov networks, Consistent group selection in high-dimensional linear regression, Gene selection and prediction for cancer classification using support vector machines with a reject option, Group coordinate descent algorithms for nonconvex penalized regression, From compression to compressed sensing, Simultaneous estimation and factor selection in quantile regression via adaptive sup-norm regularization, Fixed and random effects selection in nonparametric additive mixed models, A majorization-minimization approach to variable selection using spike and slab priors, Sparsity with sign-coherent groups of variables via the cooperative-Lasso, Variable selection for sparse Dirichlet-multinomial regression with an application to microbiome data analysis, On the asymptotic properties of the group lasso estimator for linear models, Forest Garrote, Maximum likelihood estimation in the logistic regression model with a cure fraction, The adaptive and the thresholded Lasso for potentially misspecified models (and a lower bound for the Lasso), The smooth-Lasso and other \(\ell _{1}+\ell _{2}\)-penalized methods, The log-linear group-lasso estimator and its asymptotic properties, Simultaneous multiple response regression and inverse covariance matrix estimation via penalized Gaussian maximum likelihood, The Bayesian adaptive Lasso regression, Subset selection in Poisson regression, Compressed sensing of color images, Proximal methods for the latent group lasso penalty, On the linear convergence of a proximal gradient method for a class of nonsmooth convex minimization problems, Oracle inequalities and optimal inference under group sparsity, Concave group methods for variable selection and estimation in high-dimensional varying coefficient models, Robust \(L_p\)-norm least squares support vector regression with feature selection, On the linear convergence of the approximate proximal splitting method for non-smooth convex optimization, Discussion: One-step sparse estimates in nonconcave penalized likelihood models, A greedy feature selection algorithm for big data of high dimensionality, Inexact variable metric stochastic block-coordinate descent for regularized optimization, Logistic regression: from art to science, A coordinate gradient descent method for nonsmooth separable minimization, Nonconcave penalized composite conditional likelihood estimation of sparse Ising models, Jackknife model averaging prediction methods for complex phenotypes with gene expression levels by integrating external pathway information, Sparse modeling of categorial explanatory variables, Adaptive group Lasso for high-dimensional generalized linear models, High-dimensional Ising model selection using \(\ell _{1}\)-regularized logistic regression, Least angle and \(\ell _{1}\) penalized regression: a review, On asymptotically optimal confidence regions and tests for high-dimensional models, Enhanced ridge regressions, Fast marginal likelihood estimation of penalties for group-adaptive elastic net, Globalized inexact proximal Newton-type methods for nonconvex composite functions, Ensembling classification models based on phalanxes of variables with applications in drug discovery, Lasso-type recovery of sparse representations for high-dimensional data, Some theoretical results on the grouped variables Lasso, Penalized Estimation of Directed Acyclic Graphs From Discrete Data, Stable graphical model estimation with random forests for discrete, continuous, and mixed variables, A Note on Coding and Standardization of Categorical Variables in (Sparse) Group Lasso Regression, Multi-Resolution Functional ANOVA for Large-Scale, Many-Input Computer Experiments, Double fused Lasso regularized regression with both matrix and vector valued predictors, Accuracy guaranties for \(\ell_{1}\) recovery of block-sparse signals, An outer-inner linearization method for non-convex and nondifferentiable composite regularization problems, Penalized estimation in additive varying coefficient models using grouped regularization, On Bayesian lasso variable selection and the specification of the shrinkage parameter, A tutorial on rank-based coefficient estimation for censored data in small- and large-scale problems, APPLE: approximate path for penalized likelihood estimators, Sample size determination for training cancer classifiers from microarray and RNA-seq data, Block-coordinate gradient descent method for linearly constrained nonsmooth separable optimization, Penalized Cox's proportional hazards model for high-dimensional survival data with grouped predictors, The \(\ell_{2,q}\) regularized group sparse optimization: lower bound theory, recovery bound and algorithms, Quantile regression feature selection and estimation with grouped variables using Huber approximation, High-dimensional additive modeling, Sparsistency and rates of convergence in large covariance matrix estimation, Double regularization methods for robust feature selection and SVM classification via DC programming, Group penalized quantile regression, Inertial proximal incremental aggregated gradient method with linear convergence guarantees, Crossing time windows optimization based on mutual information for hybrid BCI, High dimensional generalized linear models for temporal dependent data, Regression with adaptive Lasso and correlation based penalty, Penalized polygram regression, Model selection in linear mixed models, Linear convergence of prox-SVRG method for separable non-smooth convex optimization problems under bounded metric subregularity, Volumes of unit balls of mixed sequence spaces, Bayesian penalized model for classification and selection of functional predictors using longitudinal MRI data from ADNI, Model averaging for generalized linear models in fragmentary data prediction, A Trust-region Method for Nonsmooth Nonconvex Optimization, Unnamed Item, A statistical methodology to select covariates in high-dimensional data under dependence. Application to the classification of genetic profiles in oncology, Causal Interaction in Factorial Experiments: Application to Conjoint Analysis, A new Gibbs sampler for Bayesian lasso, The pre-image problem for Laplacian Eigenmaps utilizing L ₁ regularization with applications to data fusion, Solving constrained nonsmooth group sparse optimization via group Capped-\(\ell_1\) relaxation and group smoothing proximal gradient algorithm, Covariance prediction via convex optimization, Bayesian group selection in logistic regression with application to MRI data analysis, Local optimality for stationary points of group zero-norm regularized problems and equivalent surrogates, Generalized linear models with structured sparsity estimators, Two-stage penalized algorithms via integrating prior information improve gene selection from omics data, Group sparse recovery via group square-root elastic net and the iterative multivariate thresholding-based algorithm, An Efficient Convex Formulation for Reduced-Rank Linear Discriminant Analysis in High Dimensions, Sparse feedback stabilisation of linear delay systems by proximal gradient method, Model-Based Clustering of High-Dimensional Longitudinal Data via Regularization, A unified analysis of convex and non-convex \(\ell_p\)-ball projection problems, A novel group VIF regression for group variable selection with application to multiple change-point detection, Linearly-convergent FISTA variant for composite optimization with duality, Simultaneous variable and factor selection via sparse group lasso in factor analysis, Introducing Lasso-type penalisation to generalised joint regression modelling for count data, A consistent variable screening procedure with family-wise error control, Statistical Inference for High-Dimensional Generalized Linear Models With Binary Outcomes, A Review of Data‐Driven Discovery for Dynamic Systems, A Bayesian group selection with compositional responses for analysis of radiologic tumor proportions and their genomic determinants, A convex-Nonconvex strategy for grouped variable selection, Lasso in Infinite dimension: application to variable selection in functional multivariate linear regression, Low-Rank Regression Models for Multiple Binary Responses and their Applications to Cancer Cell-Line Encyclopedia Data, Robust estimation in regression and classification methods for large dimensional data, Duality of optimization problems with gauge functions, A backpropagation learning algorithm with graph regularization for feedforward neural networks, Prediction in Cancer Genomics Using Topological Signatures and Machine Learning, Unnamed Item, On the advantages of the non-concave penalized likelihood model selection method with minimum prediction errors in large-scale medical studies, Grouped penalization estimation of the osteoporosis data in the traditional Chinese medicine, Construction of disease risk scoring systems using logistic group lasso: application to porcine reproductive and respiratory syndrome survey data, Multi-Armed Angle-Based Direct Learning for Estimating Optimal Individualized Treatment Rules With Various Outcomes, Time-varying Hazards Model for Incorporating Irregularly Measured, High-Dimensional Biomarkers, A new multicollinearity diagnostic for generalized linear models, A link-free sparse group variable selection method for single-index model, An algorithm for the multivariate group lasso with covariance estimation, A generalized additive model approach to time-to-event analysis, A Logistic Normal Multinomial Regression Model for Microbiome Compositional Data Analysis, Iteratively Reweighted Group Lasso Based on Log-Composite Regularization, Group descent algorithms for nonconvex penalized linear and logistic regression models with grouped predictors, A fast unified algorithm for solving group-lasso penalize learning problems, A selective review of group selection in high-dimensional models, Computation of second-order directional stationary points for group sparse optimization, Model selection and parameter estimation of a multinomial logistic regression model, Regularized receiver operating characteristic-based logistic regression for grouped variable selection with composite criterion, Bi-level variable selection via adaptive sparse group Lasso, High-Dimensional Feature Selection by Feature-Wise Kernelized Lasso, cmenet: A New Method for Bi-Level Variable Selection of Conditional Main Effects, Unnamed Item, Iteration Complexity of a Block Coordinate Gradient Descent Method for Convex Optimization, Variance estimation based on blocked 3×2 cross-validation in high-dimensional linear regression, Taylor quasi-likelihood for limited generalized linear models, Structural identification and variable selection in high-dimensional varying-coefficient models, Parallel block coordinate minimization with application to group regularized regression, On the impact of model selection on predictor identification and parameter inference, Posterior contraction in group sparse logit models for categorical responses, Group variable selection and estimation in the Tobit censored response model, Variable selection for semiparametric regression models with iterated penalisation, Penalized Gaussian Process Regression and Classification for High-Dimensional Nonlinear Data, Group variable selection in cardiopulmonary cerebral resuscitation data for veterinary patients, Bayesian group selection with non-local priors, GSDAR: a fast Newton algorithm for \(\ell_0\) regularized generalized linear models with statistical guarantee, On the robustness of the generalized fused Lasso to prior specifications, Grouped Variable Selection Using Area under the ROC with Imbalanced Data, Exact penalties for decomposable convex optimization problems, Generalized t‐statistic for two‐group classification, Estimation for High-Dimensional Linear Mixed-Effects Models Using ℓ1-Penalization, Structured Sparsity: Discrete and Convex Approaches, MIP-BOOST: Efficient and Effective L₀ Feature Selection for Linear Regression, The robust nearest shrunken centroids classifier for high-dimensional heavy-tailed data, Simultaneous analysis of Lasso and Dantzig selector, A data-driven line search rule for support recovery in high-dimensional data analysis, New Robust Variable Selection Methods for Linear Regression Models, Robust variable selection in the logistic regression model, Robust grouped variable selection using distributionally robust optimization, Efficient block-coordinate descent algorithms for the group Lasso, A smoothing stochastic gradient method for composite optimization, Overlapping group lasso for high-dimensional generalized linear models, Unnamed Item, Variable selection with group LASSO approach: Application to Cox regression with frailty model, Ensemble of penalized logistic models for classification of high-dimensional data, Multiple Kernel Learningの学習理論, A modified multinomial baseline logit model with logit functions having different covariates, Grouped Transformations and Regularization in High-Dimensional Explainable ANOVA Approximation, Grouped feature importance and combined features effect plot, IPF-LASSO: integrative \(L_1\)-penalized regression with penalty factors for prediction based on multi-omics data, The degrees of freedom of partly smooth regularizers, Globally sparse and locally dense signal recovery for compressed sensing, A Note on Application of Nesterov’s Method in Solving Lasso-Type Problems, A mixed integer linear programming support vector machine for cost-effective group feature selection: branch-cut-and-price approach, Simultaneous confidence bands in a zero-inflated regression model for binary data, Quantile regression with group Lasso for classification, A uniform framework for the combination of penalties in generalized structured models, Logistic biplot for nominal data, PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting, Graph-based sparse linear discriminant analysis for high-dimensional classification, Adaptive bi-level variable selection for multivariate failure time model with a diverging number of covariates, A random block-coordinate Douglas-Rachford splitting method with low computational complexity for binary logistic regression, Non-asymptotic oracle inequalities for the Lasso and Group Lasso in high dimensional logistic model, Flexible tree-structured regression models for discrete event times, Consistent tuning parameter selection in high-dimensional group-penalized regression, Unnamed Item, High-dimensional generalized linear models and the lasso, Support union recovery in high-dimensional multivariate regression, Variable selection for sparse logistic regression, Variable selection in Cox regression models with varying coefficients, Sparse estimation technique for digital pre-distortion of impedance-mismatched power amplifiers, On proximal gradient method for the convex problems regularized with the group reproducing kernel norm, Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function, Learning from a lot: Empirical Bayes for high‐dimensional model‐based prediction, Regression and subgroup detection for heterogeneous samples, Unnamed Item, Fully asynchronous stochastic coordinate descent: a tight lower bound on the parallelism achieving linear speedup, PUlasso: High-Dimensional Variable Selection With Presence-Only Data, On the stability and generalization of neural networks with VC dimension and fuzzy feature encoders, Unnamed Item, Multinomial logit models with implicit variable selection, L₁Penalized Estimation in the Cox Proportional Hazards Model, Forward-Backward Selection with Early Dropping, Bridge regression: adaptivity and group selection, Proximal gradient method with automatic selection of the parameter by automatic differentiation, Classification tree algorithm for grouped variables, Distributed and consensus optimization for non-smooth image reconstruction, Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models, Using the EM algorithm for Bayesian variable selection in logistic regression models with related covariates, Bayesian variable selection logistic regression with paired proteomic measurements, Robust group non-convex estimations for high-dimensional partially linear models, Modular proximal optimization for multidimensional total-variation regularization, Fuzzy Lasso regression model with exact explanatory variables and fuzzy responses, AIC for the group Lasso in generalized linear models, A Model-Averaging Approach for High-Dimensional Regression, Variable selection and prediction using a nested, matched case‐control study: Application to hospital acquired pneumonia in stroke patients, Informative gene selection for microarray classification via adaptive elastic net with conditional mutual information, Accelerated alternating direction method of multipliers: an optimal \(O(1 / K)\) nonergodic analysis, Simulation-based Inference in a Zero-inflated Bernoulli Regression Model, Estimation bounds and sharp oracle inequalities of regularized procedures with Lipschitz loss functions, Non-concave penalization in linear mixed-effect models and regularized selection of fixed effects, Adaptively weighted group Lasso for semiparametric quantile regression models, High-dimensional generalized linear models incorporating graphical structure among predictors, Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models, Nonparametric additive beta regression for fractional response with application to body fat data, Optimization problems involving group sparsity terms, A two-step fixed-point proximity algorithm for a class of non-differentiable optimization models in machine learning, Lasso-type penalization in the framework of generalized additive models for location, scale and shape, Rating scales as predictors -- the old question of scale level and some answers, Sure Independence Screening for Ultrahigh Dimensional Feature Space, Stability Selection, A penalty approach to differential item functioning in Rasch models, Unnamed Item, Sparse high-dimensional varying coefficient model: nonasymptotic minimax study, Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning, A group VISA algorithm for variable selection, Class probability estimation for medical studies

Uses Software

• SparseLOGREG

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• A coordinate gradient descent method for nonsmooth separable minimization
• Least angle regression. (With discussion)
• High-dimensional generalized linear models and the lasso
• Classifiers of support vector machine type with \(\ell_1\) complexity regularization
• Regularization of Wavelet Approximations
• A new approach to variable selection in least squares problems
• Model Selection and Estimation in Regression with Grouped Variables