Mixtures and products in two graphical models

DOI10.18409/JAS.V9I1.90zbMATH Open1422.62062arXiv1709.05276OpenAlexW2963669332MaRDI QIDQ5226931FDOQ5226931

Authors: Anna Leah Seigal, Guido Montúfar 

Publication date: 2 August 2019

Published in: Journal of Algebraic Statistics (Search for Journal in Brave)

Abstract: We compare two statistical models of three binary random variables. One is a mixture model and the other is a product of mixtures model called a restricted Boltzmann machine. Although the two models we study look different from their parametrizations, we show that they represent the same set of distributions on the interior of the probability simplex, and are equal up to closure. We give a semi-algebraic description of the model in terms of six binomial inequalities and obtain closed form expressions for the maximum likelihood estimates. We briefly discuss extensions to larger models.

Full work available at URL: https://arxiv.org/abs/1709.05276

Recommendations

• scientific article; zbMATH DE number 4126504
• Mixtures of marginal models
• Sum-product graphical models
• scientific article; zbMATH DE number 7085059
• Decomposition of models whose marginal distributions are mixtures
• Mixture models and applications
• scientific article; zbMATH DE number 568800
• Inference for mixtures

zbMATH Keywords

maximum likelihood estimationmixture modelrestricted Boltzmann machinesemi-algebraic statistics

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Characterization and structure theory of statistical distributions (62E10) Toric varieties, Newton polyhedra, Okounkov bodies (14M25) Polyhedra and polytopes; regular figures, division of spaces (51M20) Low codimension problems in algebraic geometry (14M07)

Cited In (5)

• Optimal Transport to a Variety
• Geometry of linear convolutional networks
• When does a mixture of products contain a product of mixtures?
• Geometry of fitness landscapes: peaks, shapes and universal positive epistasis
• Conditional independence ideals with hidden variables

This page was built for publication: Mixtures and products in two graphical models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5226931)