Mixture-based estimation of entropy

DOI10.1016/J.CSDA.2022.107582OpenAlexW3091985597MaRDI QIDQ82866FDOQ82866

Authors: Stéphane Robin, Luca Scrucca, Stéphane Robin, Luca Scrucca 

Publication date: January 2023

Published in: Computational Statistics and Data Analysis (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2010.04058

Recommendations

• Finite mixtures of MaxEnt distributions
• Nonparametric estimation in semi-parametric univariate mixture models
• Some new results on information properties of mixture distributions
• A Bayesian nonparametric estimation to entropy
• Entropic risk minimization for nonparametric estimation of mixing distributions

zbMATH Keywords

mixture modelsentropy estimationGaussian mixturesmutual information

Mathematics Subject Classification ID

Statistics (62-XX)

Cites Work

• Estimating the dimension of a model
• Bayesian model averaging: A tutorial. (with comments and a rejoinder).
• Title not available (Why is that?)
• Bayesian Density Estimation and Inference Using Mixtures
• Elements of Information Theory
• Finite mixture and Markov switching models.
• Model-Based Gaussian and Non-Gaussian Clustering
• Practical Bayesian Density Estimation Using Mixtures of Normals
• A Mathematical Theory of Communication
• Sample estimate of the entropy of a random vector
• Projection Pursuit Based on Gaussian Mixtures and Evolutionary Algorithms
• Integrative exploration of large high-dimensional datasets
• An overview on the progeny of the skew-normal family -- a personal perspective
• Handbook of differential entropy
• Title not available (Why is that?)
• Title not available (Why is that?)
• Simple and Globally Convergent Methods for Accelerating the Convergence of Any EM Algorithm
• Kullback-Leibler divergence measure for multivariate skew-normal distributions
• Title not available (Why is that?)
• A transformation-based approach to Gaussian mixture density estimation for bounded data
• The Skew-normal Distribution and Related Multivariate Families*
• Shannon entropy and Kullback-Leibler divergence in multivariate log fundamental skew-normal and related distributions
• Approximating discrete probability distributions with dependence trees

Cited In (4)

• Entropy fluctuations to quantify mixedness
• mclustAddons
• Mixtures: sequential stability of variational entropy solutions
• On the Entropy Computation of Large Complex Gaussian Mixture Distributions

Uses Software

• mclust
• R
• UCI-ml
• flexmix
• sn
• mpmi
• infotheo
• IndepTest
• ppgmmga
• rmi

This page was built for publication: Mixture-based estimation of entropy

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q82866)