Sparse estimation of large covariance matrices via a nested Lasso penalty
From MaRDI portal
Publication:2482977
Abstract: The paper proposes a new covariance estimator for large covariance matrices when the variables have a natural ordering. Using the Cholesky decomposition of the inverse, we impose a banded structure on the Cholesky factor, and select the bandwidth adaptively for each row of the Cholesky factor, using a novel penalty we call nested Lasso. This structure has more flexibility than regular banding, but, unlike regular Lasso applied to the entries of the Cholesky factor, results in a sparse estimator for the inverse of the covariance matrix. An iterative algorithm for solving the optimization problem is developed. The estimator is compared to a number of other covariance estimators and is shown to do best, both in simulations and on a real data example. Simulations show that the margin by which the estimator outperforms its competitors tends to increase with dimension.
Recommendations
- A Cholesky-based estimation for large-dimensional covariance matrices
- Covariance matrix selection and estimation via penalised normal likelihood
- Regularized estimation of large covariance matrices
- Adaptive estimation of covariance matrices via Cholesky decomposition
- Computationally efficient banding of large covariance matrices for ordered data and connections to banding the inverse Cholesky factor
Cites work
- scientific article; zbMATH DE number 3136275 (Why is no real title available?)
- scientific article; zbMATH DE number 3673370 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A well-conditioned estimator for large-dimensional covariance matrices
- Class prediction by nearest shrunken centroids, with applications to DNA microarrays.
- Covariance matrix selection and estimation via penalised normal likelihood
- Efficient estimation of covariance selection models
- Empirical Bayes estimation of the multivariate normal covariance matrix
- Estimation of a covariance matrix under Stein's loss
- Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter vari\-ants
- High dimensional covariance matrix estimation using a factor model
- Joint mean-covariance models with applications to longitudinal data: unconstrained parameterisation
- Model selection and estimation in the Gaussian graphical model
- Nonparametric Estimation of Covariance Structure in Longitudinal Data
- Nonparametric estimation of large covariance matrices of longitudinal data
- On consistency and sparsity for principal components analysis in high dimensions
- On the distribution of the largest eigenvalue in principal components analysis
- Parsimonious Covariance Matrix Estimation for Longitudinal Data
- Pathwise coordinate optimization
- Regularized estimation of large covariance matrices
- Ridge Regression: Biased Estimation for Nonorthogonal Problems
- Some theory for Fisher's linear discriminant function, `naive Bayes', and some alternatives when there are many more variables than observations
- Sparsity and Smoothness Via the Fused Lasso
- The elements of statistical learning. Data mining, inference, and prediction
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(70)- Bandwidth selection for large covariance and precision matrices
- A new approach for ultrahigh dimensional precision matrix estimation
- A Stratified Penalized Kernel Method for Semiparametric Variable Labeling and Estimation of Multi-Output Time-Varying Coefficient Models for Nonstationary Time Series
- Sparse precision matrix estimation under lower polynomial moment assumption
- A DC programming approach for sparse estimation of a covariance matrix
- High-dimensional covariance estimation for Gaussian directed acyclic graph models with given order
- Testing for practically significant dependencies in high dimensions via bootstrapping maxima of \(U\)-statistics
- Nonparametric covariance estimation with shrinkage toward stationary models
- Sparse estimation of multivariate Poisson log‐normal models from count data
- The Bayesian nested Lasso for mixed frequency regression models
- Bayesian sparse graphical models and their mixtures
- Trade-off between predictive performance and FDR control for high-dimensional Gaussian model selection
- Bayesian nonstationary and nonparametric covariance estimation for large spatial data (with discussion)
- Estimation of banded time-varying precision matrix based on SCAD and group Lasso
- Robust estimation in joint mean-covariance regression model for longitudinal data
- Robust sparse precision matrix estimation for high-dimensional compositional data
- Estimating summary statistics in the spike-train space
- Covariance estimation: the GLM and regularization perspectives
- High dimensional sparse covariance estimation via directed acyclic graphs
- Nonparametric modeling of longitudinal covariance structure in functional mapping of quantitative trait loci
- Sparse permutation invariant covariance estimation
- Forward adaptive banding for estimating large covariance matrices
- Hierarchical sparse modeling: a choice of two group Lasso formulations
- Ultrahigh dimensional precision matrix estimation via refitted cross validation
- Lasso, fractional norm and structured sparse estimation using a Hadamard product parametrization
- Adjusting for high-dimensional covariates in sparse precision matrix estimation by \(\ell_1\)-penalization
- Heterogeneous tail generalized COMFORT modeling via Cholesky decomposition
- A constrained \(\ell1\) minimization approach for estimating multiple sparse Gaussian or nonparanormal graphical models
- Correlation structure selection for longitudinal data with diverging cluster size
- Detecting the dimensionality for principal components model
- Sparsistency and rates of convergence in large covariance matrix estimation
- Structural factor equation models for causal network construction via directed acyclic mixed graphs
- Estimation and optimal structure selection of high-dimensional Toeplitz covariance matrix
- Test for bandedness of high-dimensional covariance matrices and bandwidth estimation
- Estimating spatial covariance using penalised likelihood with weightedL1penalty
- High dimensional covariance matrix estimation by penalizing the matrix-logarithm transformed likelihood
- The Generalized Ridge Estimator of the Inverse Covariance Matrix
- Estimating large correlation matrices for international migration
- Learning local dependence in ordered data
- Cholesky-based model averaging for covariance matrix estimation
- Group Lasso estimation of high-dimensional covariance matrices
- Improved multivariate normal mean estimation with unknown covariance when \(p\) is greater than \(n\)
- An adjoint-free four-dimensional variational data assimilation method via a modified Cholesky decomposition and an iterative Woodbury matrix formula
- Covariance estimation via fiducial inference
- Rates of convergence in conditional covariance matrix with nonparametric entries estimation
- Nonparametric estimation of covariance functions by model selection
- Estimation of covariance matrix via the sparse Cholesky factor with lasso
- New sequence spaces and function spaces on interval \([0, 1]\)
- A simple numerical method based simultaneous stochastic perturbation for estimation of high dimensional matrices
- Adaptive estimation of covariance matrices via Cholesky decomposition
- Informative estimation and selection of correlation structure for longitudinal data
- Parsimony inducing priors for large scale state-space models
- Minimax estimation of large precision matrices with bandable Cholesky factor
- Network exploration via the adaptive LASSO and SCAD penalties
- Regularized estimation of precision matrix for high-dimensional multivariate longitudinal data
- Penalized least squares estimation with weakly dependent data
- Covariance regularization by thresholding
- Individual-specific, sparse inverse covariance estimation in generalized estimating equations
- Penalized model-based clustering with unconstrained covariance matrices
- A cautionary note on generalized linear models for covariance of unbalanced longitudinal data
- Adaptive Tests for Bandedness of High-dimensional Covariance Matrices
- A Cholesky-based estimation for large-dimensional covariance matrices
- Bayesian estimation of large precision matrix based on Cholesky decomposition
- A scalable sparse Cholesky based approach for learning high-dimensional covariance matrices in ordered data
- Covariance matrix selection and estimation via penalised normal likelihood
- Robust estimation of sparse precision matrix using adaptive weighted graphical lasso approach
- Graph-guided banding of the covariance matrix
- Bayesian sparse covariance decomposition with a graphical structure
- Multilevel Gaussian graphical model for multilevel networks
- Regularized parameter estimation in high-dimensional Gaussian mixture models
This page was built for publication: Sparse estimation of large covariance matrices via a nested Lasso penalty
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2482977)
