Families of alpha-, beta- and gamma-divergences: flexible and robust measures of similarities

DOI10.3390/E12061532zbMATH Open1229.94030OpenAlexW2150070703WikidataQ60486701 ScholiaQ60486701MaRDI QIDQ657474FDOQ657474

Shun-Ichi Amari, Andrzej Cichocki

Publication date: 9 January 2012

Published in: Entropy (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.3390/e12061532

zbMATH Keywords

similarity measures[https://portal.mardi4nfdi.de/w/index.php?title=+Special%3ASearch&search=Csisz%EF%BF%BD%EF%BF%BDr-Morimoto+and+Bregman+divergences&go=Go Csisz��r-Morimoto and Bregman divergences]extended itakura-saito like divergencesgeneralized divergences[https://portal.mardi4nfdi.de/w/index.php?title=+Special%3ASearch&search=Tsallis+and+R%EF%BF%BD%EF%BF%BDnyi+entropies&go=Go Tsallis and R��nyi entropies]

Mathematics Subject Classification ID

Measures of information, entropy (94A17)

Cited In (75)

• Divergence-Based Vector Quantization
• Title not available (Why is that?)
• Shape constrained density estimation via penalized Rényi divergence
• Cramér-Rao lower bounds arising from generalized Csiszár divergences
• Indefinite Proximity Learning: A Review
• AUTOMATIC RELEVANCE DETERMINATION IN NONNEGATIVE MATRIX FACTORIZATION BASED ON A ZERO-INFLATED COMPOUND POISSON-GAMMA DISTRIBUTION
• On divergence measures leading to Jeffreys and other reference priors
• Nyström subsampling method for coefficient-based regularized regression
• Multidimensional scaling in dually flat spaces
• Image segmentation using level set driven by generalized divergence
• Robust sparse Gaussian graphical modeling
• Nonparametric information geometry: from divergence function to referential-representational biduality on statistical manifolds
• Cut-off Phenomenon for Converging Processes in the Sense of α-Divergence Measures
• Projective power entropy and maximum Tsallis entropy distributions
• A unified statistical approach to non-negative matrix factorization and probabilistic latent semantic indexing
• The geometry of mixed-Euclidean metrics on symmetric positive definite matrices
• \(\gamma\)-SUP: a clustering algorithm for cryo-electron microscopy images of asymmetric particles
• Normalized estimating equation for robust parameter estimation
• Binary classification with a pseudo exponential model and its application for multi-task learning
• Log-determinant divergences revisited: alpha-beta and gamma log-det divergences
• Duality of maximum entropy and minimum divergence
• Copula modelling with penalized complexity priors: the bivariate case
• Generalized Canonical Polyadic Tensor Decomposition
• A non-negative matrix factorization model based on the zero-inflated Tweedie distribution
• A study of Rényi entropy based on the information geometry formalism
• Divergence measures estimation and its asymptotic normality theory in the discrete case
• Orthogonal nonnegative matrix tri-factorization based on Tweedie distributions
• On the robustness of the Bayes and Wiener estimators under model uncertainty
• Re-examination of Bregman functions and new properties of their divergences
• Quantum divergences with \(p\)-power means
• Projection theorems and estimating equations for power-law models
• f-Betas and portfolio optimization with f-divergence induced risk measures
• Least informative distributions in maximum \(q\)-log-likelihood estimation
• Generalized twin Gaussian processes using Sharma-Mittal divergence
• Entropy based risk measures
• Robust estimation in stochastic frontier models
• Supervised nonnegative matrix factorization via minimization of regularized Moreau-envelope of divergence function with application to music transcription
• IMPROVED ESTIMATORS OF BREGMAN DIVERGENCE FOR MODEL SELECTION IN SMALL SAMPLES
• Similarities, Dissimilarities and Types of Inner Products for Data Analysis in the Context of Machine Learning
• Algorithms for Nonnegative Matrix Factorization with the β-Divergence
• Affine invariant divergences associated with proper composite scoring rules and their applications
• Infinite-dimensional gradient-based descent for alpha-divergence minimisation
• A reference-invariant health disparity index based on Rényi divergence
• Title not available (Why is that?)
• TYPE II TOPP-LEONE INVERSE WEIBULL DISTRIBUTION WITH STATISTICAL PROPERTIES AND APPLICATIONS
• \textit{Maxallent}: maximizers of all entropies and uncertainty of uncertainty
• Transport information Bregman divergences
• AN ACTIVE CONTOUR MODEL FOR TEXTURE IMAGE SEGMENTATION USING RÉNYI DIVERGENCE MEASURE
• Optimal rates for coefficient-based regularized regression
• Entropy characteristics of macrosystems with nonlinear pair interactions
• Multiplicative updates for convolutional NMF under \(\beta\)-divergence
• Statistical modeling of robust non-negative matrix factorization based on \(\gamma \)-divergence and its applications
• Rational approximations of spectral densities based on the Alpha divergence
• A dynamical system approach for continuous nonnegative matrix factorization
• Similarity matrix analysis and divergence measures for statistical detection of unknown deterministic signals hidden in additive noise
• Variational representations of annealing paths: Bregman information under monotonic embedding
• Distributionally Robust Markov Decision Processes and Their Connection to Risk Measures
• Distributed robust regression with correntropy losses and regularization kernel networks
• Nonnegative Matrix Factorization and Log-Determinant Divergences
• The Kullback-Leibler divergence between lattice Gaussian distributions
• Sketch-based multiplicative updating algorithms for symmetric nonnegative tensor factorizations with applications to face image clustering
• Daisee: Adaptive importance sampling by balancing exploration and exploitation
• BETA DIVERGENCE AND KERNELS METHODS WITH SUPPORT VECTOR MACHINE (SVM)
• \( \lambda \)-deformed evidence lower bound (\( \lambda \)-ELBO) using Rényi and Tsallis divergence
• Appropriate Data Density Models in Probabilistic Machine Learning Approaches for Data Analysis
• Linear inverse problems with nonnegativity constraints: singularity of optimisers
• Minimizing robust density power-based divergences for general parametric density models
• A unified approach to the Pythagorean identity and projection theorem for a class of divergences based on M-estimations
• Adaptation of the tuning parameter in general Bayesian inference with robust divergence
• Pairwise learning problems with regularization networks and Nyström subsampling approach
• Myopic robust index tracking with Bregman divergence
• Optimal shrinkage estimation of predictive densities under \(\alpha\)-divergences
• Exponentiality test based on alpha-divergence and gamma-divergence
• A note on how Renyi entropy can create a spectrum of probabilistic merging operators
• Testing bivariate independence based on α -divergence by improved probit transformation method for copula density estimation

Recommendations

• Probabilistic distance measures of the Dirichlet and beta distributions 👍 👎
• A Jensen-Gini measure of divergence with application in parameter estimation 👍 👎
• A new family of divergence measures for tests of fit 👍 👎
• Mixed ƒ-divergence for Multiple Pairs of Measures 👍 👎
• TYPE II TOPP-LEONE INVERSE WEIBULL DISTRIBUTION WITH STATISTICAL PROPERTIES AND APPLICATIONS 👍 👎
• Title not available (Why is that?) 👍 👎
• Title not available (Why is that?) 👍 👎
• Title not available (Why is that?) 👍 👎

This page was built for publication: Families of alpha-, beta- and gamma-divergences: flexible and robust measures of similarities

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q657474)