The discrete infinite logistic normal distribution

DOI10.1214/12-BA734MaRDI QIDQ2633953zbMATH OpenOpenAlexFDO

Authors John Paisley, Chong Wang, David M. Blei

Publication date 5 February 2016

Published in Bayesian Analysis (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1103.4789, https://projecteuclid.org/euclid.ba/1354024470

zbMATH Keywords

Dirichlet processGaussian processmixed-membership models

Mathematics Subject Classification ID

Gaussian processes (60G15) Random measures (60G57) Exact distribution theory in statistics (62E15) Bayesian inference (62F15) Applications of statistics to social sciences (62P25)

Abstract: We present the discrete infinite logistic normal distribution (DILN), a Bayesian nonparametric prior for mixed membership models. DILN is a generalization of the hierarchical Dirichlet process (HDP) that models correlation structure between the weights of the atoms at the group level. We derive a representation of DILN as a normalized collection of gamma-distributed random variables, and study its statistical properties. We consider applications to topic modeling and derive a variational inference algorithm for approximate posterior inference. We study the empirical performance of the DILN topic model on four corpora, comparing performance with the HDP and the correlated topic model (CTM). To deal with large-scale data sets, we also develop an online inference algorithm for DILN and compare with online HDP and online LDA on the Nature magazine, which contains approximately 350,000 articles.

Recommendations

• A correlated topic model of science
• Hierarchical Dirichlet Processes
• Hierarchical Dirichlet scaling process
• Variational inference for Dirichlet process mixtures
• scientific article; zbMATH DE number 6377992

Cited in

(6)

• Nonparametric Bayesian negative binomial factor analysis
• Hierarchical Dirichlet scaling process
• Truncated simulation and inference in edge-exchangeable networks
• A variational inference for the Lévy adaptive regression with multiple kernels
• Non-parametric Bayes to infer playing strategies adopted in a population of mobile gamers
• A correlated topic model of science

This page was built for publication: The discrete infinite logistic normal distribution

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2633953)