Feature allocations, probability functions, and paintboxes

DOI10.1214/13-BA823zbMATH Open1329.62278arXiv1301.6647OpenAlexW2112410777MaRDI QIDQ908036FDOQ908036

Authors: Tamara Broderick, Michael Jordan, Jim Pitman 

Publication date: 2 February 2016

Published in: Bayesian Analysis (Search for Journal in Brave)

Abstract: The problem of inferring a clustering of a data set has been the subject of much research in Bayesian analysis, and there currently exists a solid mathematical foundation for Bayesian approaches to clustering. In particular, the class of probability distributions over partitions of a data set has been characterized in a number of ways, including via exchangeable partition probability functions (EPPFs) and the Kingman paintbox. Here, we develop a generalization of the clustering problem, called feature allocation, where we allow each data point to belong to an arbitrary, non-negative integer number of groups, now called features or topics. We define and study an "exchangeable feature probability function" (EFPF)---analogous to the EPPF in the clustering setting---for certain types of feature models. Moreover, we introduce a "feature paintbox" characterization---analogous to the Kingman paintbox for clustering---of the class of exchangeable feature models. We provide a further characterization of the subclass of feature allocations that have EFPF representations.

Full work available at URL: https://arxiv.org/abs/1301.6647

Recommendations

• Cluster and feature modeling from combinatorial stochastic processes
• A characterization of product-form exchangeable feature probability functions
• Gibbs-type Indian buffet processes
• Exchangeable trait allocations
• Generalized Ewens-Pitman model for Bayesian clustering

zbMATH Keywords

featureIndian buffet processbeta processEFPFfeature allocationfeature frequency modelpaintbox

Mathematics Subject Classification ID

Bayesian inference (62F15) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Random measures (60G57) Exchangeability for stochastic processes (60G09)

Cited In (17)

• Gibbs-type Indian buffet processes
• Flexible regularized estimation in high-dimensional mixed membership models
• Regenerative random permutations of integers
• The combinatorial structure of beta negative binomial processes
• Exchangeable trait allocations
• A Bayesian feature allocation model for tumor heterogeneity
• A characterization of product-form exchangeable feature probability functions
• Nonparametric Bayesian inference in applications
• Partitions and Ewens distributions in element-free probability theory
• Consensus Monte Carlo for Random Subsets Using Shared Anchors
• A nonuniform local limit theorem for Poisson binomial random variables via Stein’s method
• The Poisson binomial distribution -- old \& new
• Local exchangeability
• Bayesian inference for latent biologic structure with determinantal point processes (DPP)
• Sufficientness postulates for Gibbs-type priors and hierarchical generalizations
• Approximating predictive probabilities of Gibbs-type priors
• Cluster and feature modeling from combinatorial stochastic processes

This page was built for publication: Feature allocations, probability functions, and paintboxes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q908036)