High-dimensional regression with unknown variance
From MaRDI portal
Abstract: We review recent results for high-dimensional sparse linear regression in the practical case of unknown variance. Different sparsity settings are covered, including coordinate-sparsity, group-sparsity and variation-sparsity. The emphasis is put on non-asymptotic analyses and feasible procedures. In addition, a small numerical study compares the practical performance of three schemes for tuning the Lasso estimator and some references are collected for some more general models, including multivariate regression and nonparametric regression.
Recommendations
Cites work
- \(\ell_{1}\)-penalization for mixture regression models
- A new algorithm for fixed design regression and denoising
- A note on the Lasso and related procedures in model selection
- A simple proof of the restricted isometry property for random matrices
- A survey of cross-validation procedures for model selection
- A transformation theorem for one-dimensional f-expansions
- Adaptive Forward-Backward Greedy Algorithm for Learning Sparse Representations
- Adaptive Lasso for sparse high-dimensional regression models
- Aggregation for Gaussian regression
- An optimal selection of regression variables
- Asymptotic optimality for \(C_ p\), \(C_ L\), cross-validation and generalized cross-validation: Discrete index set
- Asymptotic properties of criteria for selection of variables in multiple regression
- Asymptotically optimal difference-based estimation of variance in nonparametric regression
- Atomic Decomposition by Basis Pursuit
- Comments on: \(\ell _{1}\)-penalization for mixture regression models
- Comments on: \(\ell_{1}\)-penalization for mixture regression models
- Compressed sensing
- Consistency of the group Lasso and multiple kernel learning
- Consistency of trace norm minimization
- Detecting multiple change-points in the mean of Gaussian process by model selection
- Estimating Linear Restrictions on Regression Coefficients for Multivariate Normal Distributions
- Estimating the dimension of a model
- Estimation of (near) low-rank matrices with noise and high-dimensional scaling
- Estimation of Gaussian graphs by model selection
- Estimation of high-dimensional low-rank matrices
- Estimator selection in the Gaussian setting
- Estimator selection with respect to Hellinger-type risks
- Exponential screening and optimal rates of sparse estimation
- Gaussian model selection
- Gaussian model selection with an unknown variance
- Graph selection with GGMselect
- High-dimensional Gaussian model selection on a Gaussian design
- High-dimensional graphs and variable selection with the Lasso
- High-dimensional regression with unknown variance
- scientific article; zbMATH DE number 3483405 (Why is no real title available?)
- scientific article; zbMATH DE number 1034037 (Why is no real title available?)
- scientific article; zbMATH DE number 3444596 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Information Theory and Mixing Least-Squares Regressions
- Information-Theoretic Limits on Sparsity Recovery in the High-Dimensional and Noisy Setting
- Learning Bounds for Kernel Regression Using Effective Data Dimensionality
- Least angle regression. (With discussion)
- Linear Model Selection by Cross-Validation
- Low rank multivariate regression
- Minimal penalties for Gaussian model selection
- Minimax Rates of Estimation for High-Dimensional Linear Regression Over \ell_q-Balls
- Minimax risks for sparse regressions: ultra-high dimensional phenomenons
- Mixing least-squares estimators when the variance is unknown
- Model Selection and Estimation in Regression with Grouped Variables
- Nearly unbiased variable selection under minimax concave penalty
- Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion
- Observed universality of phase transitions in high-dimensional geometry, with implications for modern data analysis and signal processing
- On the conditions used to prove oracle results for the Lasso
- Optimal selection of reduced rank estimators of high-dimensional matrices
- Oracle inequalities and optimal inference under group sparsity
- Rank penalized estimators for high-dimensional matrices
- Rate minimaxity of the Lasso and Dantzig selector for the \(l_{q}\) loss in \(l_{r}\) balls
- Reduced-rank regression for the multivariate linear model
- Regularization and Variable Selection Via the Elastic Net
- Risk bounds for model selection via penalization
- Robust Statistics
- Segmentation of the mean of heteroscedastic data via cross-validation
- Simultaneous analysis of Lasso and Dantzig selector
- Slope heuristics: overview and implementation
- Some Comments on C P
- Sparsity and Smoothness Via the Fused Lasso
- Sparsity regret bounds for individual sequences in online linear regression
- Square-root lasso: pivotal recovery of sparse signals via conic programming
- The L₁ convergence of kernel density estimates
- The Adaptive Lasso and Its Oracle Properties
- The Bayesian Lasso
- The benefit of group sparsity
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The Predictive Sample Reuse Method with Applications
- UPS delivers optimal phase diagram in high-dimensional variable selection
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(26)- Estimator selection in the Gaussian setting
- Estimating the error variance in a high-dimensional linear model
- Oracle inequalities for high-dimensional prediction
- Optimal bounds for aggregation of affine estimators
- Adaptive estimation of high-dimensional signal-to-noise ratios
- Minimax risks for sparse regressions: ultra-high dimensional phenomenons
- Greedy variance estimation for the LASSO
- Second-order Stein: SURE for SURE and other applications in high-dimensional inference
- High-dimensional regression with potential prior information on variable importance
- How can we identify the sparsity structure pattern of high-dimensional data: an elementary statistical analysis to interpretable machine learning
- Global-local mixtures: a unifying framework
- A global homogeneity test for high-dimensional linear regression
- Prediction error bounds for linear regression with the TREX
- Estimation of linear projections of non-sparse coefficients in high-dimensional regression
- A fast algorithm for the semi-definite relaxation of the state estimation problem in power grids
- High dimensional matrix estimation with unknown variance of the noise
- Linear hypothesis testing in dense high-dimensional linear models
- A study of error variance estimation in Lasso regression
- scientific article; zbMATH DE number 1471718 (Why is no real title available?)
- The partial linear model in high dimensions
- Estimation of high-dimensional seemingly unrelated regression models
- Introduction to the special issue on sparsity and regularization methods
- High-dimensional regression with unknown variance
- A Critical Review of LASSO and Its Derivatives for Variable Selection Under Dependence Among Covariates
- Trade-off between predictive performance and FDR control for high-dimensional Gaussian model selection
- SOCP based variance free Dantzig selector with application to robust estimation
This page was built for publication: High-dimensional regression with unknown variance
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5965306)
