Latent variable graphical model selection via convex optimization
From MaRDI portal
Abstract: Suppose we observe samples of a subset of a collection of random variables. No additional information is provided about the number of latent variables, nor of the relationship between the latent and observed variables. Is it possible to discover the number of latent components, and to learn a statistical model over the entire collection of variables? We address this question in the setting in which the latent and observed variables are jointly Gaussian, with the conditional statistics of the observed variables conditioned on the latent variables being specified by a graphical model. As a first step we give natural conditions under which such latent-variable Gaussian graphical models are identifiable given marginal statistics of only the observed variables. Essentially these conditions require that the conditional graphical model among the observed variables is sparse, while the effect of the latent variables is "spread out" over most of the observed variables. Next we propose a tractable convex program based on regularized maximum-likelihood for model selection in this latent-variable setting; the regularizer uses both the norm and the nuclear norm. Our modeling framework can be viewed as a combination of dimensionality reduction (to identify latent variables) and graphical modeling (to capture remaining statistical structure not attributable to the latent variables), and it consistently estimates both the number of latent components and the conditional graphical model structure among the observed variables. These results are applicable in the high-dimensional setting in which the number of latent/observed variables grows with the number of samples of the observed variables. The geometric properties of the algebraic varieties of sparse matrices and of low-rank matrices play an important role in our analysis.
Recommendations
- Graphical model selection for Gaussian conditional random fields in the presence of latent variables
- Graphical model selection with latent variables
- Learning loopy graphical models with latent variables: efficient methods and guarantees
- Alternating Direction Methods for Latent Variable Gaussian Graphical Model Selection
- Interpreting latent variables in factor models via convex optimization
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 47926 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 1134987 (Why is no real title available?)
- scientific article; zbMATH DE number 3244317 (Why is no real title available?)
- scientific article; zbMATH DE number 3381785 (Why is no real title available?)
- A well-conditioned estimator for large-dimensional covariance matrices
- Characterization of the subdifferential of some matrix norms
- Compressed sensing
- Covariance regularization by thresholding
- Equivalent Subgradient Versions of Hamiltonian and Euler–Lagrange Equations in Variational Analysis
- Exact matrix completion via convex optimization
- For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution
- Gaussian Markov distributions over finite graphs
- Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization
- High dimensional covariance matrix estimation using a factor model
- High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
- High-dimensional graphs and variable selection with the Lasso
- Local operator theory, random matrices and Banach spaces.
- Nonparametric estimation of large covariance matrices of longitudinal data
- On the distribution of the largest eigenvalue in principal components analysis
- Operator norm consistent estimation of large-dimensional sparse covariance matrices
- Rank-Sparsity Incoherence for Matrix Decomposition
- Regularized estimation of large covariance matrices
- Rejoinder: Latent variable graphical model selection via convex optimization
- Robust principal component analysis?
- Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
- SDPT3 — A Matlab software package for semidefinite programming, Version 1.3
- Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$-Constrained Quadratic Programming (Lasso)
- Solving log-determinant optimization problems by a Newton-CG primal proximal point algorithm
- Sparse permutation invariant covariance estimation
- Sparsistency and rates of convergence in large covariance matrix estimation
- ``Ideal parent structure learning for continuous variable Bayesian networks
Cited in
(only showing first 100 items - show all)- Tightness of the maximum likelihood semidefinite relaxation for angular synchronization
- Estimation of graphical models through structured norm minimization
- Graphical model selection with latent variables
- The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent
- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- Learning a factor model via regularized PCA
- Two-stage convex relaxation approach to low-rank and sparsity regularized least squares loss
- Joint Gaussian graphical model estimation: a survey
- Forward-backward splitting with Bregman distances
- Structure learning for zero-inflated counts with an application to single-cell RNA sequencing data
- Learning latent tree graphical models
- A multi-stage convex relaxation approach to noisy structured low-rank matrix recovery
- Nonlinear Causal Discovery with Confounders
- Generalized network psychometrics: combining network and latent variable models
- Learning semidefinite regularizers
- Regularized estimation of high-dimensional factor-augmented vector autoregressive (FAVAR) models
- An Algebraic Estimator for Large Spectral Density Matrices
- Estimating a covariance matrix for market risk management and the case of credit default swaps
- Bayesian sparse covariance decomposition with a graphical structure
- Adjusted regularization in latent graphical models: application to multiple-neuron spike count data
- Adjusted regularization of cortical covariance
- Improved proximal ADMM with partially parallel splitting for multi-block separable convex programming
- Rejoinder: Latent variable graphical model selection via convex optimization
- General parameterized proximal point algorithm with applications in statistical learning
- Learning latent variable Gaussian graphical model for biomolecular network with low sample complexity
- Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning
- Adaptive estimation in structured factor models with applications to overlapping clustering
- High-dimensional covariance matrix estimation
- A parallel splitting ALM-based algorithm for separable convex programming
- Generalized symmetric ADMM for separable convex optimization
- Detection of block-exchangeable structure in large-scale correlation matrices
- Sparse linear identifiable multivariate modeling
- Adaptive estimation in multivariate response regression with hidden variables
- Detection of hubs in complex networks by the Laplacian matrix
- Stable local-smooth principal component pursuit
- Linear estimating equations for exponential families with application to Gaussian linear concentration models
- Alternating direction based method for optimal control problem constrained by Stokes equation
- Learning linear non-Gaussian causal models in the presence of latent variables
- On model selection consistency of regularized M-estimators
- Convergence of ADMM for Three-Block Separable Quadratic Programming Problems with Linear Constraints
- A derivative-free \textit{RMIL} conjugate gradient projection method for convex constrained nonlinear monotone equations with applications in compressive sensing
- Incomplete graphical model inference via latent tree aggregation
- An algorithm twisted from generalized ADMM for multi-block separable convex minimization models
- On the global and linear convergence of direct extension of ADMM for 3-block separable convex minimization models
- A rank-two relaxed parallel splitting version of the augmented Lagrangian method with step size in (0,2) for separable convex programming
- Latent Network Estimation and Variable Selection for Compositional Data Via Variational EM
- Level-set methods for convex optimization
- Learning a Bayesian network with multiple latent variables for implicit relation representation
- Estimation of graphical models: an overview of selected topics
- Scalable robust matrix recovery: Frank-Wolfe meets proximal methods
- Toward a multisubject analysis of neural connectivity
- Estimating structured high-dimensional covariance and precision matrices: optimal rates and adaptive estimation
- Nonstationary Modeling With Sparsity for Spatial Data via the Basis Graphical Lasso
- Large factor model estimation by nuclear norm plus \(\ell_1\) norm penalization
- Modified proximal symmetric ADMMs for multi-block separable convex optimization with linear constraints
- latentgraph
- Characterizing brain connectivity from human electrocorticography recordings with unobserved inputs during epileptic seizures
- Recent developments in high dimensional covariance estimation and its related issues, a review
- Topology identification under spatially correlated noise
- Robust Causal Structure Learning with Some Hidden Variables
- A class of ADMM-based algorithms for three-block separable convex programming
- Nonparametric Finite Mixture of Gaussian Graphical Models
- Alternating proximal gradient method for convex minimization
- Nonsparse learning with latent variables
- A partially isochronous splitting algorithm for three-block separable convex minimization problems
- Psychometric network models from time-series and panel data
- Inference in High-Dimensional Multivariate Response Regression with Hidden Variables
- scientific article; zbMATH DE number 7255155 (Why is no real title available?)
- Integrative methods for post-selection inference under convex constraints
- Large covariance estimation through elliptical factor models
- Dimension-wise sparse low-rank approximation of a matrix with application to variable selection in high-dimensional integrative analyzes of association
- Asymptotic normality and optimalities in estimation of large Gaussian graphical models
- Bridging convex and nonconvex optimization in robust PCA: noise, outliers and missing data
- Parallel multi-block ADMM with \(o(1/k)\) convergence
- Hidden factor estimation in dynamic generalized factor analysis models
- Graphical model selection for Gaussian conditional random fields in the presence of latent variables
- Interpretation of the precision matrix and its application in estimating sparse brain connectivity during sleep spindles from human electrocorticography recordings
- Pairwise sparse + low-rank models for variables of mixed type
- Comment on ``Hypothesis testing by convex optimization
- A large covariance matrix estimator under intermediate spikiness regimes
- Learning loopy graphical models with latent variables: efficient methods and guarantees
- Bi-cross-validation for factor analysis
- The convergence rate of the proximal alternating direction method of multipliers with indefinite proximal regularization
- Proximal Markov chain Monte Carlo algorithms
- Adaptive estimation of the copula correlation matrix for semiparametric elliptical copulas
- Scalable interpretable multi-response regression via SEED
- A proximal alternating direction method of multipliers with a substitution procedure
- Structure learning of Bayesian networks with latent variables via sparse and low-rank decomposition
- Pivotal variable detection of the covariance matrix and its application to high-dimensional factor models
- scientific article; zbMATH DE number 7306913 (Why is no real title available?)
- A dual-primal balanced augmented Lagrangian method for linearly constrained convex programming
- Latent-variable Gaussian graphical model structure learning by GEMS algorithm
- Sparse plus low-rank identification for dynamical latent-variable graphical AR models
- Rejoinder: Invariance, causality and robustness
- On the convergence of the direct extension of ADMM for three-block separable convex minimization models with one strongly convex function
- Alternating Direction Methods for Latent Variable Gaussian Graphical Model Selection
- A survey on some recent developments of alternating direction method of multipliers
- Learning Gaussian graphical models with latent confounders
- Doubly debiased Lasso: high-dimensional inference under hidden confounding
- Decomposition into low-rank plus additive matrices for background/foreground separation: a review for a comparative evaluation with a large-scale dataset
This page was built for publication: Latent variable graphical model selection via convex optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q132216)
