Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
From MaRDI portal
(Redirected from Publication:5881076)
Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models (scientific article; zbMATH DE number 7661374)
Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models (scientific article; zbMATH DE number 7661374)
Abstract: We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimation and variable selection in linear regression with grouped variables. We further extend the SSGL to sparse generalized additive models (GAMs), thereby introducing the first nonparametric variant of the spike-and-slab lasso methodology. Our model simultaneously performs group selection and estimation, while our fully Bayes treatment of the mixture proportion allows for model complexity control and automatic self-adaptivity to different levels of sparsity. We develop theory to uniquely characterize the global posterior mode under the SSGL and introduce a highly efficient block coordinate ascent algorithm for maximum a posteriori (MAP) estimation. We further employ de-biasing methods to provide uncertainty quantification of our estimates. Thus, implementation of our model avoids the computational intensiveness of Markov chain Monte Carlo (MCMC) in high dimensions. We derive posterior concentration rates for both grouped linear regression and sparse GAMs when the number of covariates grows at nearly exponential rate with sample size. Finally, we illustrate our methodology through extensive simulations and data analysis.
Recommendations
Cites work
- A fast unified algorithm for solving group-lasso penalize learning problems
- A selective review of group selection in high-dimensional models
- Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- Bayesian linear regression for multivariate responses under group sparsity
- Bayesian penalty mixing: the case of a non-separable penalty
- Bayesian regression tree ensembles that adapt to smoothness and sparsity
- Bayesian regularization for graphical models with unequal shrinkage
- Bayesian variable selection and estimation for group Lasso
- Bayesian variable selection regression of multivariate responses for group data
- Debiasing the Lasso: optimal sample size for Gaussian designs
- Dirichlet-Laplace priors for optimal shrinkage
- Estimating the health effects of environmental mixtures using Bayesian semiparametric regression and sparsity inducing priors
- Group descent algorithms for nonconvex penalized linear and logistic regression models with grouped predictors
- High-dimensional confounding adjustment using continuous Spike and Slab priors
- High-dimensional graphs and variable selection with the Lasso
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Local asymptotics for regression splines and confidence regions
- Minimax-optimal rates for sparse additive models over kernel classes via convex programming
- Model Selection and Estimation in Regression with Grouped Variables
- Multivariate sparse group Lasso for the multivariate multiple linear regression with an arbitrary group structure
- On asymptotically optimal confidence regions and tests for high-dimensional models
- On singular values of matrices with independent rows
- Penalized regression, standard errors, and Bayesian Lassos
- Random forests
- Restricted eigenvalue properties for correlated Gaussian designs
- Simultaneous Variable and Covariance Selection With the Multivariate Spike-and-Slab LASSO
- Sparse additive models
- Sparse Bayesian additive nonparametric regression with application to health effects of pesticides mixtures
- Super Learner
- Supremum norm posterior contraction and credible sets for nonparametric multivariate regression
- The spike-and-slab LASSO
- Variance prior forms for high-dimensional Bayesian variable selection
Cited in
(30)- Bayesian Bootstrap Spike-and-Slab LASSO
- Hierarchical sparse modeling: a choice of two group Lasso formulations
- Sparse group fused Lasso for model segmentation: a hybrid approach
- Incorporating spatial structure into inclusion probabilities for Bayesian variable selection in generalized linear models with the spike-and-slab elastic net
- Spike-and-slab Lasso biclustering
- Bayesian variable selection and estimation for group Lasso
- The spike-and-slab LASSO
- Spike-and-slab priors for function selection in structured additive regression models
- Bayesian nonparametric hypothesis testing for longitudinal data analysis
- A Bayesian approach for partial Gaussian graphical models with sparsity
- The EAS approach to variable selection for multivariate response data in high-dimensional settings
- A Mass-Shifting Phenomenon of Truncated Multivariate Normal Priors
- Spike-and-slab least absolute shrinkage and selection operator generalized additive models and scalable algorithms for high-dimensional data analysis
- Adaptive posterior concentration rates for sparse high-dimensional linear regression with random design and unknown error variance
- Empirical Bayes large-scale multiple testing for high-dimensional binary outcome data
- Projection pursuit Bayesian regression for symmetric matrix predictors
- Quantifying predictive uncertainty of aphasia severity in stroke patients with sparse heteroscedastic Bayesian high-dimensional regression
- Estimating sparse direct effects in multivariate regression with the spike-and-slab LASSO
- A Bayesian collocation integral method for system identification of ordinary differential equations
- Hierarchical grouped horseshoe priors for subgroup identification and estimation
- Bayesian covariate-dependent graph learning with a dual group spike-and-slab prior
- Posterior contraction and uncertainty quantification for the multivariate spike-and-slab LASSO
- Spatial Adaptive Selection using Binary Conditional Autoregressive Model with Application to Brain-Computer Interface
- Bayesian Multilevel Network Recovery Selection
- Variable selection via non-convex group penalization for high-dimensional nonparametric additive panel data models with fixed effects
- Group regression with tailored penalties for high-dimensional data with or without predefined groups
- Borrowing strength across exposures and outcomes via index models for multi-pollutant mixtures
- Bayesian group regularization in generalized linear models with a continuous spike-and-slab prior
- Bayesian variable selection under high-dimensional settings with grouped covariates
- Posterior concentration rates for Bayesian penalized splines
Describes a project that uses
Uses Software
This page was built for publication: Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5881076)
