Learning local dependence in ordered data
From MaRDI portal
Publication:5361309
zbMATH Open1433.68385arXiv1604.07451MaRDI QIDQ5361309FDOQ5361309
Authors: Guo Yu, Jacob Bien 
Publication date: 27 September 2017
Abstract: In many applications, data come with a natural ordering. This ordering can often induce local dependence among nearby variables. However, in complex data, the width of this dependence may vary, making simple assumptions such as a constant neighborhood size unrealistic. We propose a framework for learning this local dependence based on estimating the inverse of the Cholesky factor of the covariance matrix. Penalized maximum likelihood estimation of this matrix yields a simple regression interpretation for local dependence in which variables are predicted by their neighbors. Our proposed method involves solving a convex, penalized Gaussian likelihood problem with a hierarchical group lasso penalty. The problem decomposes into independent subproblems which can be solved efficiently in parallel using first-order methods. Our method yields a sparse, symmetric, positive definite estimator of the precision matrix, encoding a Gaussian graphical model. We derive theoretical results not found in existing methods attaining this structure. In particular, our conditions for signed support recovery and estimation consistency rates in multiple norms are as mild as those in a regression problem. Empirical results show our method performing favorably compared to existing methods. We apply our method to genomic data to flexibly model linkage disequilibrium. Our method is also applied to improve the performance of discriminant analysis in sound recording classification.
Full work available at URL: https://arxiv.org/abs/1604.07451
Recommendations
- A scalable sparse Cholesky based approach for learning high-dimensional covariance matrices in ordered data
- Computationally efficient banding of large covariance matrices for ordered data and connections to banding the inverse Cholesky factor
- Sparse estimation of large covariance matrices via a nested Lasso penalty
- Learning Gaussian graphical models with fractional marginal pseudo-likelihood
- High-dimensional Gaussian graphical models on network-linked data
Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05) Estimation in multivariate analysis (62H12) Measures of association (correlation, canonical correlation, etc.) (62H20) Probabilistic graphical models (62H22) Ridge regression; shrinkage estimators (Lasso) (62J07)
Cited In (17)
- Posterior graph selection and estimation consistency for high-dimensional Bayesian DAG models
- Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates
- A scalable sparse Cholesky based approach for learning high-dimensional covariance matrices in ordered data
- On the non-local priors for sparsity selection in high-dimensional Gaussian DAG models
- High-dimensional covariance estimation for Gaussian directed acyclic graph models with given order
- Bayesian joint inference for multiple directed acyclic graphs
- Estimation of banded time-varying precision matrix based on SCAD and group Lasso
- Title not available (Why is that?)
- Minimax posterior convergence rates and model selection consistency in high-dimensional DAG models based on sparse Cholesky factors
- A projection-based conditional dependence measure with applications to high-dimensional undirected graphical models
- Regularized estimation of precision matrix for high-dimensional multivariate longitudinal data
- A Bayesian approach for learning Bayesian network structures
- The Generalized Ridge Estimator of the Inverse Covariance Matrix
- A review of Gaussian Markov models for conditional independence
- Limited memory BFGS method for least squares semidefinite programming with banded structure
- Scalable Bayesian high-dimensional local dependence learning
- Graph-guided banding of the covariance matrix
This page was built for publication: Learning local dependence in ordered data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5361309)
