On the Entropy Computation of Large Complex Gaussian Mixture Distributions

DOI10.1109/TSP.2015.2441046MaRDI QIDQ4580785zbMATH OpenOpenAlexFDO

Authors Sumin Kim, Tan Tai do, Tobias J. Oechtering, Gunnar Peters

Publication date 22 August 2018

Published in IEEE Transactions on Signal Processing (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1502.03790

Mathematics Subject Classification ID

Signal theory (characterization, reconstruction, filtering, etc.) (94A12) Measures of information, entropy (94A17)

Abstract: The entropy computation of Gaussian mixture distributions with a large number of components has a prohibitive computational complexity. In this paper, we propose a novel approach exploiting the sphere decoding concept to bound and approximate such entropy terms with reduced complexity and good accuracy. Moreover, we propose an SNR region based enhancement of the approximation method to reduce the complexity even further. Using Monte-Carlo simulations, the proposed methods are numerically demonstrated for the computation of the mutual information including the entropy term of various channels with finite constellation modulations such as binary and quadratic amplitude modulation (QAM) inputs for communication applications.

Recommendations

• Gaussian mixtures: entropy and geometric inequalities
• Arbitrarily Tight Bounds on Differential Entropy of Gaussian Mixtures
• Estimation of the complexity of a finite mixture distribution: from well- to less known methods
• Stochastic complexities of Gaussian mixtures in variational Bayesian approximation
• A cross-entropy scheme for mixtures
• The Differential Entropy of Mixtures: New Bounds and Applications
• Mixture-based estimation of entropy
• On Gaussian Components of Finite Mixtures of Probability Distributions
• Estimation of the entropy of a multivariate normal distribution
• The entropy of a mixture of probability distributions

This page was built for publication: On the Entropy Computation of Large Complex Gaussian Mixture Distributions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4580785)