Partial correlation graphical LASSO
From MaRDI portal
Abstract: Standard likelihood penalties to learn Gaussian graphical models are based on regularising the off-diagonal entries of the precision matrix. Such methods, and their Bayesian counterparts, are not invariant to scalar multiplication of the variables, unless one standardises the observed data to unit sample variances. We show that such standardisation can have a strong effect on inference and introduce a new family of penalties based on partial correlations. We show that the latter, as well as the maximum likelihood, and logarithmic penalties are scale invariant. We illustrate the use of one such penalty, the partial correlation graphical LASSO, which sets an penalty on partial correlations. The associated optimization problem is no longer convex, but is conditionally convex. We show via simulated examples and in two real datasets that, besides being scale invariant, there can be important gains in terms of inference.
Cites work
- A computationally fast alternative to cross-validation in penalized Gaussian graphical models
- Bayesian graphical Lasso models and efficient posterior computation
- Bayesian lasso regression
- Bayesian regularization for graphical models with unequal shrinkage
- Bayesian structure learning in graphical models
- Coordinate descent algorithms
- Dependence in elliptical partial correlation graphs
- Discussion: One-step sparse estimates in nonconcave penalized likelihood models
- Efficient random coordinate descent algorithms for large-scale structured nonconvex optimization
- Enhancing sparsity by reweighted \(\ell _{1}\) minimization
- Estimating large correlation matrices for international migration
- High-dimensional graphs and variable selection with the Lasso
- Model selection and estimation in the Gaussian graphical model
- Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data
- Nearly unbiased variable selection under minimax concave penalty
- Network exploration via the adaptive LASSO and SCAD penalties
- Partial correlation estimation by joint sparse regression models
- Partial correlation matrix estimation using ridge penalty followed by thresholding and re-estimation
- Shrinkage tuning parameter selection in precision matrices estimation
- Sparse inverse covariance estimation with the graphical lasso
- The Bayesian covariance lasso
- The Bayesian Lasso
- Tuning parameter selection for penalized likelihood estimation of Gaussian graphical model
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(2)
This page was built for publication: Partial correlation graphical LASSO
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6196791)