High-dimensional graphs and variable selection with the Lasso
From MaRDI portal
Publication:2500458
Abstract: The pattern of zero entries in the inverse covariance matrix of a multivariate normal distribution corresponds to conditional independence restrictions between variables. Covariance selection aims at estimating those structural zeros from data. We show that neighborhood selection with the Lasso is a computationally attractive alternative to standard covariance selection for sparse high-dimensional graphs. Neighborhood selection estimates the conditional independence restrictions separately for each node in the graph and is hence equivalent to variable selection for Gaussian linear models. We show that the proposed neighborhood selection scheme is consistent for sparse high-dimensional graphs. Consistency hinges on the choice of the penalty parameter. The oracle value for optimal prediction does not lead to a consistent neighborhood estimate. Controlling instead the probability of falsely joining some distinct connectivity components of the graph, consistent estimation for sparse graphs is achieved (with exponential rates), even when the number of variables grows as the number of observations raised to an arbitrary power.
Recommendations
- Sparse inverse covariance estimation with the graphical lasso
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
- Sparse covariance thresholding for high-dimensional variable selection
- A note on the Lasso for Gaussian graphical model selection
- Efficient estimation of covariance selection models
Cites work
- scientific article; zbMATH DE number 469396 (Why is no real title available?)
- scientific article; zbMATH DE number 1134987 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A Statistical View of Some Chemometrics Regression Tools
- Asymptotics for Lasso-type estimators.
- Atomic decomposition by basis pursuit
- Dependency networks for inference, collaborative filtering, and data visualization
- Functional aggregation for nonparametric regression.
- Gaussian Markov distributions over finite graphs
- Introduction to Graphical Modelling
- Least angle regression. (With discussion)
- Linear Model Selection by Cross-Validation
- Model selection for Gaussian concentration graphs
- Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
- Weak convergence and empirical processes. With applications to statistics
Cited in
(only showing first 100 items - show all)- De-noising analysis of noisy data under mixed graphical models
- Discussion: One-step sparse estimates in nonconcave penalized likelihood models
- On path restoration for censored outcomes
- Adjusting for high-dimensional covariates in sparse precision matrix estimation by _1-penalization
- Graphical Models and Message-Passing Algorithms: Some Introductory Lectures
- A shrinkage principle for heavy-tailed data: high-dimensional robust low-rank matrix recovery
- Fitting sparse linear models under the sufficient and necessary condition for model identification
- Central limit theorem for linear spectral statistics of general separable sample covariance matrices with applications
- Maximum-type tests for high-dimensional regression coefficients using Wilcoxon scores
- High-dimensional graphical inference via partially penalised regression
- A general theory of concave regularization for high-dimensional sparse estimation problems
- High-dimensional regression with unknown variance
- Adaptive estimation of the baseline hazard function in the Cox model by model selection, with high-dimensional covariates
- Estimating time-varying networks
- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- Change-point detection in high-dimensional covariance structure
- Globally adaptive quantile regression with ultra-high dimensional data
- Probabilistic graphical models and Markov networks
- Confidence intervals for sparse precision matrix estimation via Lasso penalized D-trace loss
- High-Dimensional Gaussian Graphical Regression Models with Covariates
- On stepwise pattern recovery of the fused Lasso
- A Unified Framework for Change Point Detection in High-Dimensional Linear Models
- Measuring the Stability of Results From Supervised Statistical Learning
- A statistical methodology to select covariates in high-dimensional data under dependence. Application to the classification of genetic profiles in oncology
- Oracle efficient estimation of structural breaks in cointegrating regressions
- Testing the differential network between two gaussian graphical models with false discovery rate control
- Empirical extensions of the Lasso penalty to reduce the false discovery rate in high-dimensional Cox regression models
- Learning Oncogenic Pathways from Binary Genomic Instability Data
- Simultaneous Cluster Structure Learning and Estimation of Heterogeneous Graphs for Matrix-Variate fMRI Data
- Hierarchical inference for genome-wide association studies: a view on methodology with software
- Spatio-temporal random fields: compressible representation and distributed estimation
- Introduction to the special issue on sparsity and regularization methods
- Some sharp performance bounds for least squares regression with L₁ regularization
- Multiclass analysis and prediction with network structured covariates
- Recovery of partly sparse and dense signals
- Estimation and variable selection in partial linear single index models with error-prone linear covariates
- Efficient regularized estimation of graphical proportional hazards model with interval-censored data
- Direct Learning of Sparse Changes in Markov Networks by Density Ratio Estimation
- Spectral clustering via sparse graph structure learning with application to proteomic signaling networks in cancer
- scientific article; zbMATH DE number 7559724 (Why is no real title available?)
- Robust regression via mutivariate regression depth
- Online graph topology learning from matrix-valued time series
- Joint Gaussian graphical model estimation: a survey
- Bayesian Structure Learning in Multilayered Genomic Networks
- Subgroup analysis of differential networks with latent variables
- A focused information criterion for graphical models in fMRI connectivity with high-dimensional data
- High-dimensional semiparametric Gaussian copula graphical models
- Nonparametric discriminant analysis with network structures in predictor
- Shrinkage tuning parameter selection in precision matrices estimation
- False Discovery Rate Control via Data Splitting
- Inferring sparse Gaussian graphical models with latent structure
- On the conditions used to prove oracle results for the Lasso
- Parametric or nonparametric? A parametricness index for model selection
- Joint Mean and Covariance Estimation with Unreplicated Matrix-Variate Data
- Covariance estimation: the GLM and regularization perspectives
- Learning high-dimensional directed acyclic graphs with latent and selection variables
- UPS delivers optimal phase diagram in high-dimensional variable selection
- Compound Poisson models for weighted networks with applications in finance
- Learning high-dimensional Gaussian linear structural equation models with heterogeneous error variances
- Promote sign consistency in the joint estimation of precision matrices
- Bayesian graph selection consistency under model misspecification
- Covariate assisted screening and estimation
- Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data
- Horseshoe Regularisation for Machine Learning in Complex and Deep Models1
- Flexible covariance estimation in graphical Gaussian models
- Edge selection for undirected graphs
- Latent Gaussian and Hüsler-Reiss graphical models with Golazo penalty
- High-dimensional consistency in score-based and hybrid structure learning
- Efficient distributed differential network estimation
- Graphical models for zero-inflated single cell gene expression
- Sparse regression: scalable algorithms and empirical performance
- Region selection in Markov random fields: Gaussian case
- Joint Bayesian variable and graph selection for regression models with network-structured predictors
- Hypothesis Testing of Matrix Graph Model with Application to Brain Connectivity Analysis
- Simple expressions of the Lasso and SLOPE estimators in low-dimension
- High-dimensional differential networks with sparsity and reduced-rank
- A power analysis for Model-X knockoffs with _p-regularized statistics
- Complexity analysis of Bayesian learning of high-dimensional DAG models and their equivalence classes
- Robust subspace clustering
- The smooth-Lasso and other \(\ell _{1}+\ell _{2}\)-penalized methods
- Distributed Decoding From Heterogeneous 1-Bit Compressive Measurements
- Variable selection for semiparametric regression models with iterated penalisation
- Data Analytics on Graphs Part III: Machine Learning on Graphs, from Graph Topology to Applications
- Sparse estimation of conditional graphical models with application to gene networks
- Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
- Data science, big data and statistics
- On Joint Estimation of Gaussian Graphical Models for Spatial and Temporal Data
- Group selection in high-dimensional partially linear additive models
- Model selection and local geometry
- Partial correlation estimation by joint sparse regression models
- Functional Graphical Models
- High-dimensional Gaussian graphical model selection: walk summability and local separation criterion
- Sorted concave penalized regression
- Large covariance estimation by thresholding principal orthogonal complements. With discussion and authors' reply
- Confidence intervals for low dimensional parameters in high dimensional linear models
- scientific article; zbMATH DE number 7626789 (Why is no real title available?)
- Adaptive Dantzig density estimation
- Combinatorial inference for graphical models
- Classifier variability: accounting for training and testing
- Group symmetry and covariance regularization
This page was built for publication: High-dimensional graphs and variable selection with the Lasso
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2500458)
