Group regularized estimation under structural hierarchy
From MaRDI portal
Publication:4690971
DOI10.1080/01621459.2016.1260470zbMATH Open1398.62138arXiv1411.4691OpenAlexW2248299741MaRDI QIDQ4690971FDOQ4690971
Authors: Yiyuan She, Zhifeng Wang, He Jiang 
Publication date: 23 October 2018
Published in: Journal of the American Statistical Association (Search for Journal in Brave)
Abstract: Variable selection for models including interactions between explanatory variables often needs to obey certain hierarchical constraints. The weak or strong structural hierarchy requires that the existence of an interaction term implies at least one or both associated main effects to be present in the model. Lately, this problem has attracted a lot of attention, but existing computational algorithms converge slow even with a moderate number of predictors. Moreover, in contrast to the rich literature on ordinary variable selection, there is a lack of statistical theory to show reasonably low error rates of hierarchical variable selection. This work investigates a new class of estimators that make use of multiple group penalties to capture structural parsimony. We give the minimax lower bounds for strong and weak hierarchical variable selection and show that the proposed estimators enjoy sharp rate oracle inequalities. A general-purpose algorithm is developed with guaranteed convergence and global optimality. Simulations and real data experiments demonstrate the efficiency and efficacy of the proposed approach.
Full work available at URL: https://arxiv.org/abs/1411.4691
Recommendations
Cites Work
- A lasso for hierarchical interactions
- Title not available (Why is that?)
- Title not available (Why is that?)
- Bayesian variable selection with related predictors
- Variable selection with the strong heredity constraint and its oracle property
- Distributed optimization and statistical learning via the alternating direction method of multipliers
- Simultaneous analysis of Lasso and Dantzig selector
- Regularization and Variable Selection Via the Elastic Net
- Model Selection and Estimation in Regression with Grouped Variables
- A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
- Proximal methods for hierarchical sparse coding
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
- Consistent group selection in high-dimensional linear regression
- Oracle inequalities and optimal inference under group sparsity
- An iterative algorithm for fitting nonconvex penalized generalized linear models with grouped predictors
- Weakly decomposable regularization penalties and structured sparsity
- Sparse spatial autoregressions
- Interaction screening for ultrahigh-dimensional data
- Variable selection using adaptive nonlinear interaction structures in high dimensions
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Stationary-sparse causality network learning
Cited In (25)
- HiQR: an efficient algorithm for high-dimensional quadratic regression with penalties
- A two-stage regularization method for variable selection and forecasting in high-order interaction model
- A General Framework for Identifying Hierarchical Interactions and Its Application to Genomics Data
- A Pliable Lasso
- Convex hierarchical testing of interactions
- Hierarchical sparse modeling: a choice of two group Lasso formulations
- Structured variable selection via prior-induced hierarchical penalty functions
- An analysis of penalized interaction models
- Variable selection for functional linear models with strong heredity constraint
- Efficient kernel-based variable selection with sparsistency
- Structured variable selection and estimation
- Title not available (Why is that?)
- Structured learning in time-dependent Cox models
- A First-Order Optimization Algorithm for Statistical Learning with Hierarchical Sparsity Structure
- BOLT-SSI: A Statistical Approach to Screening Interaction Effects for Ultra-High Dimensional Data
- High-dimensional interactions detection with sparse principal Hessian matrix
- Title not available (Why is that?)
- A lasso for hierarchical interactions
- Model selection for functional linear regression with hierarchical structure
- Model selection of hierarchically structured covariates using elastic net
- Sequential interaction group selection by the principle of correlation search for high-dimensional interaction models
- The composite absolute penalties family for grouped and hierarchical variable selection
- Coordinate descent based hierarchical interactive Lasso penalized logistic regression and its application to classification problems
- Variable selection with the strong heredity constraint and its oracle property
- High-Dimensional Gaussian Graphical Regression Models with Covariates
Uses Software
This page was built for publication: Group regularized estimation under structural hierarchy
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4690971)
