Scaled sparse linear regression
From MaRDI portal
Abstract: Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual square and scaling the penalty in proportion to the estimated noise level. The iterative algorithm costs little beyond the computation of a path or grid of the sparse regression estimator for penalty levels above a proper threshold. For the scaled lasso, the algorithm is a gradient descent in a convex minimization of a penalized joint loss function for the regression coefficients and noise level. Under mild regularity conditions, we prove that the scaled lasso simultaneously yields an estimator for the noise level and an estimated coefficient vector satisfying certain oracle inequalities for prediction, the estimation of the noise level and the regression coefficients. These inequalities provide sufficient conditions for the consistency and asymptotic normality of the noise level estimator, including certain cases where the number of variables is of greater order than the sample size. Parallel results are provided for the least squares estimation after model selection by the scaled lasso. Numerical results demonstrate the superior performance of the proposed methods over an earlier proposal of joint convex minimization.
Recommendations
- Sparse regression: scalable algorithms and empirical performance
- Approximate sparse linear regression
- Scalable algorithms for the sparse ridge regression
- Linear Regression With a Sparse Parameter Vector
- Sparse linear regression from perturbed data
- Sparse regression using mixed norms
- Sparse Convex Regression
- scientific article; zbMATH DE number 6866335
- Scalable holistic linear regression
- scientific article; zbMATH DE number 1843055
Cited in
(only showing first 100 items - show all)- Tuning-free heterogeneous inference in massive networks
- Asymptotic normality and optimalities in estimation of large Gaussian graphical models
- Gaussian graphical model estimation with false discovery rate control
- Edge detection in sparse Gaussian graphical models
- Significance testing in non-sparse high-dimensional linear models
- On the prediction loss of the Lasso in the partially labeled setting
- Kernel-penalized regression for analysis of microbiome data
- High-dimensional multivariate posterior consistency under global-local shrinkage priors
- Balanced estimation for high-dimensional measurement error models
- Confidence regions for entries of a large precision matrix
- Linear regression with sparsely permuted data
- Oracle inequalities for high-dimensional prediction
- Improved bounds for square-root Lasso and square-root slope
- Optimal bounds for aggregation of affine estimators
- Adaptive estimation of high-dimensional signal-to-noise ratios
- Selective inference with a randomized response
- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- On the exponentially weighted aggregate with the Laplace prior
- Debiasing the Lasso: optimal sample size for Gaussian designs
- Inference without compatibility: using exponential weighting for inference on a parameter of a linear model
- Iteratively reweighted _1-penalized robust regression
- Evaluating visual properties via robust HodgeRank
- Second-order Stein: SURE for SURE and other applications in high-dimensional inference
- Comparing six shrinkage estimators with large sample theory and asymptotically optimal prediction intervals
- In defense of the indefensible: a very naïve approach to high-dimensional inference
- Two-sample testing of high-dimensional linear regression coefficients via complementary sketching
- Improved estimators for semi-supervised high-dimensional regression model
- De-biasing the Lasso with degrees-of-freedom adjustment
- Ridge regression revisited: debiasing, thresholding and bootstrap
- High-dimensional regression with potential prior information on variable importance
- Hierarchical correction of \(p\)-values via an ultrametric tree running Ornstein-Uhlenbeck process
- Contraction of a quasi-Bayesian model with shrinkage priors in precision matrix estimation
- Scalable holistic linear regression
- Debiasing the debiased Lasso with bootstrap
- Scalable interpretable learning for multi-response error-in-variables regression
- Prediction error after model search
- Global-local mixtures: a unifying framework
- Ill-posed estimation in high-dimensional models with instrumental variables
- Innovated scalable efficient inference for ultra-large graphical models
- A significance test for the lasso
- Discussion: ``A significance test for the lasso
- Rejoinder: ``A significance test for the lasso
- Robust subspace clustering
- Pivotal estimation via square-root lasso in nonparametric regression
- High-dimensional variable screening and bias in subsequent inference, with an empirical comparison
- A global homogeneity test for high-dimensional linear regression
- Prediction error bounds for linear regression with the TREX
- Robust feature screening for elliptical copula regression model
- Testing for high-dimensional network parameters in auto-regressive models
- Sorted concave penalized regression
- Perspective maximum likelihood-type estimation via proximal decomposition
- Variance prior forms for high-dimensional Bayesian variable selection
- Lasso meets horseshoe: a survey
- Optimal designs in sparse linear models
- A two-stage sequential conditional selection approach to sparse high-dimensional multivariate regression models
- Sharp oracle inequalities for low-complexity priors
- Localized Gaussian width of \(M\)-convex hulls with applications to Lasso and convex aggregation
- The Dantzig selector for a linear model of diffusion processes
- High-dimensional tests for functional networks of brain anatomic regions
- Perspective functions: proximal calculus and applications in high-dimensional statistics
- Accuracy assessment for high-dimensional linear regression
- Correcting for unknown errors in sparse high-dimensional function approximation
- Blessing of massive scale: spatial graphical model estimation with a total cardinality constraint approach
- Penalized estimation in high-dimensional hidden Markov models with state-specific graphical models
- Penalised robust estimators for sparse and high-dimensional linear models
- Estimation of the \(\ell_2\)-norm and testing in sparse linear regression with unknown variance
- Double-estimation-friendly inference for high-dimensional misspecified models
- A permutation approach for selecting the penalty parameter in penalized model selection
- Confidence intervals for high-dimensional partially linear single-index models
- Sparse matrix inversion with scaled Lasso
- Matrix completion via max-norm constrained optimization
- On estimation of the diagonal elements of a sparse precision matrix
- The benefit of group sparsity in group inference with de-biased scaled group Lasso
- Testing a single regression coefficient in high dimensional linear models
- Linear hypothesis testing in dense high-dimensional linear models
- Regression analysis for microbiome compositional data
- AIC for the Lasso in generalized linear models
- Non-Convex Global Minimization and False Discovery Rate Control for the TREX
- Optimal equivariant prediction for high-dimensional linear models with arbitrary predictor covariance
- Statistical significance in high-dimensional linear models
- Non-negative least squares for high-dimensional linear models: consistency and sparse recovery without regularization
- Correlated variables in regression: clustering and sparse estimation
- On tight bounds for the Lasso
- Linear Regression With a Sparse Parameter Vector
- Adapting to unknown noise level in sparse deconvolution
- Goodness-of-Fit Tests for High Dimensional Linear Models
- Sharp oracle inequalities for square root regularization
- scientific article; zbMATH DE number 6866335 (Why is no real title available?)
- Sparse estimation from noisy observations of an overdetermined linear system
- Covariate assisted screening and estimation
- Selecting massive variables using an iterated conditional modes/medians algorithm
- A study on tuning parameter selection for the high-dimensional lasso
- Monte Carlo simulation for Lasso-type problems by estimator augmentation
- A Sparse Learning Approach to Relative-Volatility-Managed Portfolio Selection
- Nonsparse learning with latent variables
- Partitioned Approach for High-dimensional Confidence Intervals with Large Split Sizes
- L0-Regularized Learning for High-Dimensional Additive Hazards Regression
- Hypothesis testing in high-dimensional instrumental variables regression with an application to genomics data
- Variance estimation for sparse ultra-high dimensional varying coefficient models
- Covariate-adjusted Gaussian graphical model estimation with false discovery rate control
This page was built for publication: Scaled sparse linear regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3143465)
