Mixtures and products in two graphical models

DOI10.18409/JAS.V9I1.90MaRDI QIDQ5226931zbMATH OpenOpenAlexFDO

Authors Anna Leah Seigal, Guido Montúfar

Publication date 2 August 2019

Published in Journal of Algebraic Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1709.05276

zbMATH Keywords

maximum likelihood estimationmixture modelrestricted Boltzmann machinesemi-algebraic statistics

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Characterization and structure theory of statistical distributions (62E10) Toric varieties, Newton polyhedra, Okounkov bodies (14M25) Polyhedra and polytopes; regular figures, division of spaces (51M20) Low codimension problems in algebraic geometry (14M07)

Abstract: We compare two statistical models of three binary random variables. One is a mixture model and the other is a product of mixtures model called a restricted Boltzmann machine. Although the two models we study look different from their parametrizations, we show that they represent the same set of distributions on the interior of the probability simplex, and are equal up to closure. We give a semi-algebraic description of the model in terms of six binomial inequalities and obtain closed form expressions for the maximum likelihood estimates. We briefly discuss extensions to larger models.

Recommendations

• scientific article; zbMATH DE number 4126504
• Mixtures of marginal models
• Sum-product graphical models
• scientific article; zbMATH DE number 7085059
• Decomposition of models whose marginal distributions are mixtures
• Mixture models and applications
• scientific article; zbMATH DE number 568800
• Inference for mixtures

Cited in

(5)

• Optimal Transport to a Variety
• Geometry of linear convolutional networks
• When does a mixture of products contain a product of mixtures?
• Geometry of fitness landscapes: peaks, shapes and universal positive epistasis
• Conditional independence ideals with hidden variables

This page was built for publication: Mixtures and products in two graphical models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5226931)