Correlated random measures
From MaRDI portal
Abstract: We develop correlated random measures, random measures where the atom weights can exhibit a flexible pattern of dependence, and use them to develop powerful hierarchical Bayesian nonparametric models. Hierarchical Bayesian nonparametric models are usually built from completely random measures, a Poisson-process based construction in which the atom weights are independent. Completely random measures imply strong independence assumptions in the corresponding hierarchical model, and these assumptions are often misplaced in real-world settings. Correlated random measures address this limitation. They model correlation within the measure by using a Gaussian process in concert with the Poisson process. With correlated random measures, for example, we can develop a latent feature model for which we can infer both the properties of the latent features and their dependency pattern. We develop several other examples as well. We study a correlated random measure model of pairwise count data. We derive an efficient variational inference algorithm and show improved predictive performance on large data sets of documents, web clicks, and electronic health records.
Recommendations
Cites work
- A Bayesian analysis of some nonparametric problems
- A sticky HDP-HMM with application to speaker diarization
- An introduction to variational methods for graphical models
- Bayesian Density Estimation and Inference Using Mixtures
- Completely random measures
- Compound random measures and their use in Bayesian non-parametrics
- Fixed-form variational posterior approximation through stochastic linear regression
- Graphical models, exponential families, and variational inference
- Hierarchical Dirichlet Processes
- scientific article; zbMATH DE number 6377992 (Why is no real title available?)
- scientific article; zbMATH DE number 3688413 (Why is no real title available?)
- scientific article; zbMATH DE number 774881 (Why is no real title available?)
- Log Gaussian Cox Processes
- Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems
- Modeling for dynamic ordinal regression relationships: an application to estimating maturity of rockfish in California
- Nonparametric Bayes estimators based on beta processes in models for life history data
- Probability and stochastics.
- Random measures with aftereffects
- Spike and slab variable selection: frequentist and Bayesian strategies
- The Predictive Sample Reuse Method with Applications
- The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator
- Variational Bayesian Inference for Parametric and Nonparametric Regression With Missing Data
- Variational inference for Dirichlet process mixtures
- Variational inference for large-scale models of discrete choice
- Variational inference in nonconjugate models
Cited in
(10)- Modelling and computation using NCoRM mixtures for density regression
- Admissible Bernoulli correlations
- On Nonlinear Correlation of Random Elements
- Toward a definition and understanding of correlation for variables constrained by random relations
- Random Databases with Correlated Data
- scientific article; zbMATH DE number 3870389 (Why is no real title available?)
- Compound random measures and their use in Bayesian non-parametrics
- On quasi-infinitely divisible random measures
- On Bayesian nonparametric modelling of two correlated distributions
- Nominal correlation of inhomogeneous random sequences
This page was built for publication: Correlated random measures
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4690969)
