High-dimensional graphs and variable selection with the Lasso
From MaRDI portal
Publication:2500458
DOI10.1214/009053606000000281zbMATH Open1113.62082arXivmath/0608017OpenAlexW3098834468WikidataQ105584248 ScholiaQ105584248MaRDI QIDQ2500458FDOQ2500458
Authors: Nicolai Meinshausen, Peter Bühlmann 
Publication date: 24 August 2006
Published in: The Annals of Statistics (Search for Journal in Brave)
Abstract: The pattern of zero entries in the inverse covariance matrix of a multivariate normal distribution corresponds to conditional independence restrictions between variables. Covariance selection aims at estimating those structural zeros from data. We show that neighborhood selection with the Lasso is a computationally attractive alternative to standard covariance selection for sparse high-dimensional graphs. Neighborhood selection estimates the conditional independence restrictions separately for each node in the graph and is hence equivalent to variable selection for Gaussian linear models. We show that the proposed neighborhood selection scheme is consistent for sparse high-dimensional graphs. Consistency hinges on the choice of the penalty parameter. The oracle value for optimal prediction does not lead to a consistent neighborhood estimate. Controlling instead the probability of falsely joining some distinct connectivity components of the graph, consistent estimation for sparse graphs is achieved (with exponential rates), even when the number of variables grows as the number of observations raised to an arbitrary power.
Full work available at URL: https://arxiv.org/abs/math/0608017
Recommendations
- Sparse inverse covariance estimation with the graphical lasso
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
- Sparse covariance thresholding for high-dimensional variable selection
- A note on the Lasso for Gaussian graphical model selection
- Efficient estimation of covariance selection models
Asymptotic properties of parametric estimators (62F12) Multivariate analysis (62H99) Linear regression; mixed models (62J05) Applications of graph theory (05C90) Estimation in multivariate analysis (62H12) Ridge regression; shrinkage estimators (Lasso) (62J07)
Cites Work
- Introduction to Graphical Modelling
- Least angle regression. (With discussion)
- Weak convergence and empirical processes. With applications to statistics
- Title not available (Why is that?)
- Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
- Asymptotics for Lasso-type estimators.
- Title not available (Why is that?)
- Linear Model Selection by Cross-Validation
- A Statistical View of Some Chemometrics Regression Tools
- Gaussian Markov distributions over finite graphs
- Functional aggregation for nonparametric regression.
- Model selection for Gaussian concentration graphs
- Atomic decomposition by basis pursuit
- Dependency networks for inference, collaborative filtering, and data visualization
- Title not available (Why is that?)
Cited In (only showing first 100 items - show all)
- Estimating time-varying networks
- Some sharp performance bounds for least squares regression with \(L_1\) regularization
- Hypothesis Testing of Matrix Graph Model with Application to Brain Connectivity Analysis
- Flexible covariance estimation in graphical Gaussian models
- Statistics for big data: a perspective
- Structured Lasso for regression with matrix covariates
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Likelihood-based selection and sharp parameter estimation
- High-dimensional inference for personalized treatment decision
- Layer-wise learning strategy for nonparametric tensor product smoothing spline regression and graphical models
- Discussion: Latent variable graphical model selection via convex optimization
- Bootstrap inference for network construction with an application to a breast cancer microarray study
- High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
- Robust regression through the Huber's criterion and adaptive lasso penalty
- Optimal detection of heterogeneous and heteroscedastic mixtures
- Robust Gaussian graphical modeling via \(l_{1}\) penalization
- Stable graphical model estimation with random forests for discrete, continuous, and mixed variables
- Structural pursuit over multiple undirected graphs
- Tuning-free heterogeneous inference in massive networks
- Fitting very large sparse Gaussian graphical models
- Simultaneous inference for pairwise graphical models with generalized score matching
- Rejoinder: Latent variable graphical model selection via convex optimization
- Estimation of Gaussian graphs by model selection
- The adaptive and the thresholded Lasso for potentially misspecified models (and a lower bound for the Lasso)
- Time varying undirected graphs
- Graphical-model based high dimensional generalized linear models
- High-dimensional regression in practice: an empirical study of finite-sample prediction, variable selection and ranking
- Discussion: Latent variable graphical model selection via convex optimization
- High-dimensional joint estimation of multiple directed Gaussian graphical models
- A two-step method for estimating high-dimensional Gaussian graphical models
- Gemini: graph estimation with matrix variate normal instances
- High-dimensional variable screening and bias in subsequent inference, with an empirical comparison
- Structure estimation for discrete graphical models: generalized covariance matrices and their inverses
- Bayesian variable selection for high dimensional generalized linear models: convergence rates of the fitted densities
- Regularization and variable selection in Heckman selection model
- High-dimensional Ising model selection with Bayesian information criteria
- Variable selection in model-based clustering and discriminant analysis with a regularization approach
- Covariance and precision matrix estimation for high-dimensional time series
- Penalized estimation in high-dimensional hidden Markov models with state-specific graphical models
- On model selection consistency of regularized M-estimators
- Minimax risks for sparse regressions: ultra-high dimensional phenomenons
- Estimation for high-dimensional linear mixed-effects models using \(\ell_1\)-penalization
- Random matrix theory in statistics: a review
- Variable selection for high dimensional multivariate outcomes
- Consistency of Bayesian linear model selection with a growing number of parameters
- Preconditioning the Lasso for sign consistency
- DASSO: Connections Between the Dantzig Selector and Lasso
- An Expectation Conditional Maximization Approach for Gaussian Graphical Models
- Goodness-of-Fit Tests for High Dimensional Linear Models
- Review of statistical network analysis: models, algorithms, and software
- A semiparametric graphical modelling approach for large-scale equity selection
- Learning Sparse Causal Gaussian Networks With Experimental Intervention: Regularization and Coordinate Descent
- Latent variable graphical model selection via convex optimization
- Sparse Matrix Graphical Models
- Selection by partitioning the solution paths
- Transfer Learning under High-dimensional Generalized Linear Models
- Worst possible sub-directions in high-dimensional models
- Stability
- Variable selection in high-dimensional quantile varying coefficient models
- High-dimensional covariance matrix estimation with missing observations
- Estimation of high-dimensional graphical models using regularized score matching
- Flexible and Interpretable Models for Survival Data
- Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
- Higher criticism for large-scale inference, especially for rare and weak effects
- Estimation in high-dimensional linear models with deterministic design matrices
- Estimation of (near) low-rank matrices with noise and high-dimensional scaling
- Estimating sparse precision matrix: optimal rates of convergence and adaptive estimation
- Estimation of high-dimensional low-rank matrices
- Oracle inequalities for the lasso in the Cox model
- High-dimensional structure estimation in Ising models: local separation criterion
- A selective review of group selection in high-dimensional models
- Consistent group selection in high-dimensional linear regression
- Modeling item-item similarities for personalized recommendations on Yahoo! front page
- Discussion: One-step sparse estimates in nonconcave penalized likelihood models
- Rejoinder: One-step sparse estimates in nonconcave penalized likelihood models
- Variable selection in nonparametric additive models
- A general theory of concave regularization for high-dimensional sparse estimation problems
- High-dimensional regression with unknown variance
- Relaxed Lasso
- Conditional score matching for high-dimensional partial graphical models
- Estimating high-dimensional intervention effects from observational data
- High-Dimensional Gaussian Graphical Regression Models with Covariates
- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- Change-point detection in high-dimensional covariance structure
- On stepwise pattern recovery of the fused Lasso
- Hierarchical inference for genome-wide association studies: a view on methodology with software
- High-dimensional semiparametric Gaussian copula graphical models
- Inferring sparse Gaussian graphical models with latent structure
- On the conditions used to prove oracle results for the Lasso
- Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data
- Sparse estimation of conditional graphical models with application to gene networks
- Graphical models for zero-inflated single cell gene expression
- Partial correlation estimation by joint sparse regression models
- Group symmetry and covariance regularization
- High dimensional sparse covariance estimation via directed acyclic graphs
- Sparse permutation invariant covariance estimation
- Adaptive Lasso estimators for ultrahigh dimensional generalized linear models
- Sparse directed acyclic graphs incorporating the covariates
- Simultaneous analysis of Lasso and Dantzig selector
- Covariance-regularized regression and classification for high dimensional problems
Uses Software
This page was built for publication: High-dimensional graphs and variable selection with the Lasso
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2500458)
