A parallel algorithm for ridge-penalized estimation of the multivariate exponential family from data of mixed types

DOI10.1007/S11222-021-10013-XMaRDI QIDQ2058766zbMATH OpenOpenAlexWikidataFDO

Authors Diederik S. Laman Trip, Wessel N. van Wieringen

Publication date 9 December 2021

Published in Statistics and Computing (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1812.02401

zbMATH Keywords

networkconsistencypseudo-likelihoodparallel algorithmgraphical modelMarkov random fieldblock-wise Newton-Raphson

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Parallel numerical computation (65Y05)

Abstract: Computational efficient evaluation of penalized estimators of multivariate exponential family distributions is sought. These distributions encompass among others Markov random fields with variates of mixed type (e.g. binary and continuous) as special case of interest. The model parameter is estimated by maximization of the pseudo-likelihood augmented with a convex penalty. The estimator is shown to be consistent. With a world of multi-core computers in mind, a computationally efficient parallel Newton-Raphson algorithm is presented for numerical evaluation of the estimator alongside conditions for its convergence. Parallelization comprises the division of the parameter vector into subvectors that are estimated simultaneously and subsequently aggregated to form an estimate of the original parameter. This approach may also enable efficient numerical evaluation of other high-dimensional estimators. The performance of the proposed estimator and algorithm are evaluated and compared in a simulation study. Finally, the paper concludes with an illustration of the presented methodology in the reconstruction of the conditional independence network from data of an integrative omics study.

Recommendations

• scientific article; zbMATH DE number 1293582
• Parallel computing in linear mixed models
• Regularized parameter estimation of high dimensional distribution
• Parallel maximum likelihood estimator for multiple linear regression models
• Parallel restricted maximum likelihood estimation for linear models with a dense exogenous matrix

Cites work

• scientific article; zbMATH DE number 437298 (Why is no real title available?)
• scientific article; zbMATH DE number 3513115 (Why is no real title available?)
• scientific article; zbMATH DE number 1243473 (Why is no real title available?)
• scientific article; zbMATH DE number 1134987 (Why is no real title available?)
• A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion
• Estimation of sparse binary pairwise Markov networks using pseudo-likelihoods
• On model selection consistency of regularized M-estimators
• Ridge estimation of inverse covariance matrices from high-dimensional data
• Ridge estimation of the VAR(1) model and its time series chain graph from multivariate time-course omics data
• Selection and estimation for mixed graphical models
• Targeted fused ridge estimation of inverse covariance matrices from multiple high-dimensional data classes
• The Generalized Ridge Estimator of the Inverse Covariance Matrix
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties

Cited in

(1)

• Parallel restricted maximum likelihood estimation for linear models with a dense exogenous matrix

This page was built for publication: A parallel algorithm for ridge-penalized estimation of the multivariate exponential family from data of mixed types

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2058766)