The Burbea-Rao and Bhattacharyya Centroids
From MaRDI portal
Abstract: We study the centroid with respect to the class of information-theoretic Burbea-Rao divergences that generalize the celebrated Jensen-Shannon divergence by measuring the non-negative Jensen difference induced by a strictly convex and differentiable function. Although those Burbea-Rao divergences are symmetric by construction, they are not metric since they fail to satisfy the triangle inequality. We first explain how a particular symmetrization of Bregman divergences called Jensen-Bregman distances yields exactly those Burbea-Rao divergences. We then proceed by defining skew Burbea-Rao divergences, and show that skew Burbea-Rao divergences amount in limit cases to compute Bregman divergences. We then prove that Burbea-Rao centroids are unique, and can be arbitrarily finely approximated by a generic iterative concave-convex optimization algorithm with guaranteed convergence property. In the second part of the paper, we consider the Bhattacharyya distance that is commonly used to measure overlapping degree of probability distributions. We show that Bhattacharyya distances on members of the same statistical exponential family amount to calculate a Burbea-Rao divergence in disguise. Thus we get an efficient algorithm for computing the Bhattacharyya centroid of a set of parametric distributions belonging to the same exponential families, improving over former specialized methods found in the literature that were limited to univariate or "diagonal" multivariate Gaussians. To illustrate the performance of our Bhattacharyya/Burbea-Rao centroid algorithm, we present experimental performance results for -means and hierarchical clustering methods of Gaussian mixture models.
Cited in
(29)- Simplicial variances, potentials and Mahalanobis distances
- Optimal information, Jensen-RIG function and \(\alpha\)-Onicescu's correlation coefficient in terms of information generating functions
- Quantum Jensen-Shannon divergences between infinite-dimensional positive definite operators
- Convergence results of iterative algorithms for the sum of two monotone operators in reflexive Banach spaces.
- Generalized divergences from generalized entropies
- New estimates for Csiszár divergence and Zipf-Mandelbrot entropy via Jensen-Mercer's inequality
- Quantum divergences with p-power means
- Axiomatic generalization of the membership degree weighting function for fuzzy \(C\) means clustering: theoretical development and convergence analysis
- Matrix versions of the Hellinger distance
- Limit theorems for empirical Rényi entropy and divergence with applications to molecular diversity analysis
- Bregman divergences based on optimal design criteria and simplicial measures of dispersion
- Metrics induced by Jensen-Shannon and related divergences on positive definite matrices
- On clustering histograms with \(k\)-means by using mixed \(\alpha\)-divergences
- Covariance structure approximation via gLasso in high-dimensional supervised classification
- Skew Jensen-Bregman Voronoi diagrams
- On a new non-symmetric divergence measure
- Monte Carlo Information-Geometric Structures
- Quasiconvex Jensen divergences and quasiconvex Bregman divergences
- Two New Inertial Algorithms for Solving Variational Inequalities in Reflexive Banach Spaces
- On Geodesic Triangles with Right Angles in a Dually Flat Space
- The fractional Kullback–Leibler divergence
- Mann-type algorithms for solving the monotone inclusion problem and the fixed point problem in reflexive Banach spaces
- The Kullback-Leibler divergence between lattice Gaussian distributions
- On the f-divergences between densities of a multivariate location or scale family
- Variational representations of annealing paths: Bregman information under monotonic embedding
- Bregman methods for large-scale optimization with applications in imaging
- Towards an information-theoretic approach to population structure
- Context-sensitive hypothesis-testing and exponential families
- Foundations of bare-simulation optimization of distances
This page was built for publication: The Burbea-Rao and Bhattacharyya Centroids
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5273498)
