Divergence measures based on the Shannon entropy
From MaRDI portal
Publication:3197746
DOI10.1109/18.61115zbMath0712.94004OpenAlexW2146950091WikidataQ30040892 ScholiaQ30040892MaRDI QIDQ3197746
Publication date: 1991
Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1109/18.61115
Shannon entropydiscrimination informationmisclassification errordissimilarity measureprobability of error boundsinformation-theoretic divergence measuresKullback divergences
Related Items
The ϕ-divergence family of measures based on quantile function, Analysis of symbolic sequences using the Jensen-Shannon divergence, Jensen-Shannon divergence and non-linear quantum dynamics, Data-driven distributionally robust risk parity portfolio optimization, Approximations of Jensen divergence for twice differentiable functions, A Fermatean Fuzzy ELECTRE Method for Multi-Criteria Group Decision-Making, The n-point streaming model: how velocities shape correlation functions in redshift space, Reducing complexity in polygonal meshes with view-based saliency, Lin–Wong divergence and relations on type I censored data, Metrics induced by Jensen-Shannon and related divergences on positive definite matrices, Jensen-information generating function and its connections to some well-known information measures, Empirical survival Jensen-Shannon divergence as a goodness-of-Fit measure for maximum likelihood estimation and curve fitting, Quantum skew divergence, New definition of the cross entropy based on the Dempster-Shafer theory and its application in a decision-making process, Three-layer medical image fusion with tensor-based features, Goodness of fit test using Lin-Wong divergence based on Type-I censored data, Entropy-based pivotal statistics for multi-sample problems in planar shape, Discriminating image textures with the multiscale two-dimensional complexity-entropy causality plane, A data-driven flight schedule optimization model considering the uncertainty of operational displacement, Thermal coherence of Heisenberg model with dipole interaction and magnetic external field, Application of density similarities to predict membrane protein types based on pseudo-amino acid composition, On the benefits of representation regularization in invariance based domain generalization, Jensen-Renyi's-Tsallis fuzzy divergence information measure with its applications, Skew Jensen-Bregman Voronoi Diagrams, Hyperlink prediction via local random walks and Jensen–Shannon divergence, Knowledge graph embedding methods for entity alignment: experimental review, Segmentation of quantum generated sequences by using the Jensen-Shannon divergence, Elaboration Models with Symmetric Information Divergence, General Lebesgue integral inequalities of Jensen and Ostrowski type for differentiable functions whose derivatives in absolute value are h-convex and applications, Monte Carlo simulation of SDEs using GANs, Enhancement of the Quantum Coherence of the Rydberg Atoms System by Weak Measurement, Monotonicity conditions for avoiding counterintuitive decisions in basket trials, Detecting individual preferences and erroneous verdicts in mixed martial arts judging using Bayesian hierarchical models, Jensen-Fisher information and Jensen-Shannon entropy measures based on complementary discrete distributions with an application to Conway's game of life, Link prediction based on the mutual information with high-order clustering structure of nodes in complex networks, Deriving Probabilistic SVM Kernels from Exponential Family Approximations to Multivariate Distributions for Count Data, Some applications of the Hermite–Hadamard inequality for log‐convex functions in quantum divergences, Posterior probability measure for image matching, Fisher information and its extensions based on infinite mixture density functions, Quantitative comparison between crowd models for evacuation planning and evaluation, Efficient search for relevance explanations using MAP-independence in Bayesian networks, Fokker–Planck equations in the modeling of socio-economic phenomena, Sparse quadratic classification rules via linear dimension reduction, A new skew generalization of the normal distribution: properties and applications, A Causal Perspective on the Analysis of Signal and Noise Correlations and Their Role in Population Coding, On Csiszár and Tsallis type f-divergences induced by superquadratic and convex functions, On the role of composition entropies in the statistical mechanics of polydisperse systems, Detecting dynamical changes in time series by using the Jensen Shannon divergence, Unnamed Item, Some properties of Lin–Wong divergence on the past lifetime data, SOME REVERSES OF THE JENSEN INEQUALITY WITH APPLICATIONS, Asymptotic distributions of weighted divergence between discrete distributions, Spotting Neural Spike Patterns Using an Adversary Background Model, Rukhin's uniformity test based on sample quantiles, A Survey of Reverse Inequalities for f-Divergence Measure in Information Theory, Sequential Convex Programming for Computing Information-Theoretic Minimal Partitions: Nonconvex Nonsmooth Optimization, Lectures on Entropy. I: Information-Theoretic Notions, Unnamed Item, Length of Time’s Arrow, Mixed Solution Strategy for MCGDM Problems Using Entropy/Cross Entropy in Interval-Valued Intuitionistic Fuzzy Environment, ordpy: A Python package for data analysis with permutation entropy and ordinal network methods, Information measures of kernel estimation, Pull out all the stops: Textual analysis via punctuation sequences, A new measure between sets of probability distributions with applications to erratic financial behavior, Bayesian network modeling of the consensus between experts: an application to neuron classification, The fractional Kullback–Leibler divergence, Asymptotic approximations for the distributions of the (h‐, φ‐)‐divergence goodness‐of‐fit statistics: application to Renyi’s statistic, A simple mechanism for beyond-pairwise correlations in integrate-and-fire neurons, Generalizations of Crooks and Lin's results on Jeffreys-Csiszár and Jensen-Csiszár \(f\)-divergences, Some stochastic \textit{H H}-divergences in information theory, A new class of metric divergences on probability spaces and its applicability in statistics, Bayesian model inversion using stochastic spectral embedding, Compositional safe approximation of response time distribution of complex workflows, Bayesian inversion using adaptive polynomial chaos kriging within subset simulation, Several appropriate background distributions for entropy-based protein sequence conservation measures, The Burrows-Wheeler similarity distribution between biological sequences based on Burrows-Wheeler transform, Discovering patterns in time-varying graphs: a triclustering approach, On Jensen-Rényi and Jeffreys-Rényi type \(f\)-divergences induced by convex functions, The nonsubsampled contourlet transform based statistical medical image fusion using generalized Gaussian density, Influence of Stark-shift on quantum coherence and non-classical correlations for two two-level atoms interacting with a single-mode cavity field, A prior for record linkage based on allelic partitions, Complexity reduction and approximation of multidomain systems of partially ordered data, A Jensen-Gini measure of divergence with application in parameter estimation, A generalization of HH \(f\)-divergence, Monoparametric family of metrics derived from classical Jensen-Shannon divergence, Characterization of time series via Rényi complexity-entropy curves, Generalized divergences from generalized entropies, Long range quantum coherence, quantum \& classical correlations in Heisenberg XX chain, The landscape of communication complexity classes, Convergence of Monte Carlo distribution estimates from rival samplers, Information theory perspective on network robustness, Hormonal regulation of ovarian follicle growth in humans: model-based exploration of cycle variability and parameter sensitivities, Common information and unique disjointness, Zero-information protocols and unambiguity in Arthur-Merlin communication, Asymptotic divergence of estimates of discrete distributions, Inequalities related to some types of entropies and divergences, An information statistics approach to data stream and communication complexity, Entropy maximization and instability in uniformly magnetized plasmas, Replicator based on imitation for finite and arbitrary networked communities, Reverses of the Jensen inequality in terms of first derivative and applications, Possible world based consistency learning model for clustering and classifying uncertain data, Optimizing word set coverage for multi-event summarization, Sparsity enabled cluster reduced-order models for control, Data science applications to string theory, Some information measures for interval-valued intuitionistic fuzzy sets, Hermite-Hadamard type inequalities with applications, A compact association of particle filtering and kernel based object tracking, Optimal Boolean lattice-based algorithms for the U-curve optimization problem, Bayesian hybrid generative discriminative learning based on finite Liouville mixture models, Non-logarithmic Jensen-Shannon divergence, Optimal entropy-transport problems and a new Hellinger-Kantorovich distance between positive measures, Statistical modeling of dissimilarity increments for \(d\)-dimensional data: application in partitional clustering, Measuring information transfer by dispersion transfer entropy, Can power laws help us understand gene and proteome information?, Some bounds for skewed \(\alpha\)-Jensen-Shannon divergence, Transfer estimation of evolving class priors in data stream classification, System adjustment of data of various nature in multidisciplinary research, Entropic image segmentation of sessile drops over patterned acetate, Compositional segmentation of time series in the financial markets, Topological quantum phase transitions in the 2-D Kitaev honeycomb model, Nonparametric Bayesian image segmentation, Fundamental properties of relative entropy and Lin divergence for Choquet integral, Solving inverse problems in stochastic models using deep neural networks and adversarial training, Predicting winner and estimating margin of victory in elections using sampling, The Jensen-Shannon divergence, Integrals refining convex inequalities, A note on information entropy measures for vague sets and its applications, Clustered entropy for edge detection, Visualizations for assessing convergence and mixing of Markov chain Monte Carlo simulations, Supervised feature selection by clustering using conditional mutual information-based distances, Cross-media retrieval using query dependent search methods, Escort evolutionary game theory, Of bits and wows: a Bayesian theory of surprise with applications to attention, Spectral dimensionality reduction for Bregman information, Study of compound generalized Nakagami-generalized inverse Gaussian distribution and related densities: application to ultrasound imaging, Axiomatic generalization of the membership degree weighting function for fuzzy \(C\) means clustering: theoretical development and convergence analysis, Information analysis of the human DNA, Complexity and uncertainty analysis of financial stock markets based on entropy of scale exponential spectrum, Deterministic chaotic finite-state automata, A novel nonparametric distance estimator for densities with error bounds, Bootstrap methods for the empirical study of decision-making and information flows in social systems, The slashed-Rayleigh fading channel distribution, Machine learning for flux regression in discrete fracture networks, Some properties of Tsallis and Tsallis-Lin quantum relative entropies, Robust image watermarking using non-regular wavelets, Exponential Jensen intuitionistic fuzzy divergence measure with applications in medical investigation and pattern recognition, Estimation of divergence measures via Weighted Jensen inequality on time scales, Supervised heterogeneous feature transfer via random forests, Knowledge transfer for causal discovery, Thermal coherence of the Heisenberg model with Dzyaloshinsky-Moriya interactions in an inhomogenous external field, Improving bridge estimators via \(f\)-GAN, Natural atomic probabilities in quantum information theory, Analysis of time series through complexity-entropy curves based on generalized fractional entropy, Nonparametric bagging clustering methods to identify latent structures from a sequence of dependent categorical data, Hierarchical topic modeling with nested hierarchical Dirichlet process, Basis-independent quantum coherence and its distribution, Beyond hybrid generative discriminative learning: spherical data classification, Bounded rationality in learning, perception, decision-making, and stochastic games, A study of data-driven distributionally robust optimization with incomplete joint data under finite support, Fuzzy MABAC method based on new exponential fuzzy information measures, Relations between the observational entropy and Rényi information measures, Optimal bandwidth selection for re-substitution entropy estimation, Matching the LBO eigenspace of non-rigid shapes via high order statistics, Sequence retrieval from genomic databases, Optimal information, Jensen-RIG function and \(\alpha\)-Onicescu's correlation coefficient in terms of information generating functions, Quantum metrics based upon classical Jensen-Shannon divergence, Approximation of the integral mean divergence and \(f\)-divergence via mean results
