Variable selection, monotone likelihood ratio and group sparsity
From MaRDI portal
Publication:6042348
Abstract: In the pivotal variable selection problem, we derive the exact non-asymptotic minimax selector over the class of all -sparse vectors, which is also the Bayes selector with respect to the uniform prior. While this optimal selector is, in general, not realizable in polynomial time, we show that its tractable counterpart (the scan selector) attains the minimax expected Hamming risk to within factor 2, and is also exact minimax with respect to the probability of wrong recovery. As a consequence, we establish explicit lower bounds under the monotone likelihood ratio property and we obtain a tight characterization of the minimax risk in terms of the best separable selector risk. We apply these general results to derive necessary and sufficient conditions of exact and almost full recovery in the location model with light tail distributions and in the problem of group variable selection under Gaussian noise.
Recommendations
- A doubly sparse approach for group variable selection
- Bayesian variable selection and estimation for group Lasso
- Optimal variable selection in multi-group sparse discriminant analysis
- Sparse group variable selection via two nonconvex penalized regression models
- Group variable selection via a hierarchical lasso and its oracle property
- Within group variable selection through the exclusive Lasso
- Sparse group variable selection based on quantile hierarchical Lasso
- Group variable selection via \(\ell_{p,0}\) regularization and application to optimal scoring
- Simultaneous variable and factor selection via sparse group lasso in factor analysis
- A link-free sparse group variable selection method for single-index model
Cites work
- A comparison of the Lasso and marginal regression
- Adaptive variable selection in nonparametric sparse additive models
- Adaptive variable selection in nonparametric sparse regression
- Distribution-free multiple testing
- False discovery rate control with unknown null distribution: is it possible to mimic the oracle?
- Fundamental limits of exact support recovery in high dimensions
- High-dimensional graphs and variable selection with the Lasso
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- Iterative algorithm for discrete structure recovery
- Nearly Sharp Sufficient Conditions on Exact Sparsity Pattern Recovery
- Nearly unbiased variable selection under minimax concave penalty
- Necessary and Sufficient Conditions for Sparsity Pattern Recovery
- Optimal Variable Selection and Adaptive Noisy Compressed Sensing
- Oracle inequalities and optimal inference under group sparsity
- Orthogonal Matching Pursuit for Sparse Signal Recovery With Noise
- Partial recovery for top-\(k\) ranking: optimality of MLE and suboptimality of the spectral method
- Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$-Constrained Quadratic Programming (Lasso)
- Sup-norm convergence rate and sign concentration property of Lasso and Dantzig estimators
- The all-or-nothing phenomenon in sparse linear regression
- Thresholded Basis Pursuit: LP Algorithm for Order-Wise Optimal Support Recovery for Sparse and Approximately Sparse Signals From Noisy Random Measurements
- Uncertainty quantification for robust variable selection and multiple testing
- UPS delivers optimal phase diagram in high-dimensional variable selection
- Variable selection with Hamming loss
Cited in
(7)- Group variable selection via a hierarchical lasso and its oracle property
- Sparse group variable selection based on quantile hierarchical Lasso
- A link-free sparse group variable selection method for single-index model
- Adaptive signal recovery with Subbotin noise
- Sharp multiple testing boundary for sparse sequences
- Exact recovery in the double sparse model: sufficient and necessary signal conditions
- Mixture representations and Bayesian nonparametric inference for likelihood ratio ordered distributions
This page was built for publication: Variable selection, monotone likelihood ratio and group sparsity
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6042348)
