Relative Entropy Measures of Multivariate Dependence
bivariate measures of associationconditional measures of dependencecorrelationmeasures of multivariate dependencemultiple- correlationnominal categoricalnonparametric measures of dependenceordinal-categorical variablespartial-correlation coefficientsPearson's phi-squarerelative entropiesrelative reduction in variability
There has been a lot of work on measures of dependence or association for bivariate probability distributions or bivariate data. These measures usually assume that the variables are both continuous or both categorical. In comparison, there is very little work on multivariate or conditional measures of dependence. The purpose of this article is to discuss measures of multivariate dependence and measures of conditional dependence based on relative entropies. These measures are conceptually very general, as they can be used for a set of variables that can be a mixture of continuous, ordinal-categorical, and nominal-categorical variables. For continuous or ordinal-categorical variables, a certain transformation of relative entropy of the interval [0,1] leads to generalizations of the correlation, multiple-correlation, and partial- correlation coefficients. If all variables are nominal categorical, the relative entropies are standardized to take a maximum of 1 and then transformed so that in the bivariate case, there is a relative reduction in variability interpretation like that for the correlation coefficient. The relative entropy measures of dependence are compared with commonly used bivariate measures of association.
- Multivariate dependence measures and data analysis
- On generalized measures of entropy and dependence
- scientific article; zbMATH DE number 3858149
- On measurement of stochastic dependence in multivariate data
- On some entropy and divergence type measures of variability and dependence for mixed continuous and discrete variables
- On the entropic measures of stochastic dependence
- On measuring internal dependence in a set of random variables
- Majorization, randomness and dependence for multivariate distributions
- A generalized model for the analysis of association in ordinal contingency tables
- Relative entropy under mappings by stochastic matrices
- A simple measure of conditional dependence
- A consistent nonparametric test for serial independence
- Multivariate dependence measures and data analysis
- An asymptotic test of independence for multivariate \(t\) and Cauchy random variables with applications
- Estimation of the weights of interacting criteria from the set of profiles by means of information-theoretic functionals.
- Measures of multivariate dependence based on a distance between Fisher information matrices
- Model selection for discrete regular vine copulas
- Operational risk aggregation based on business line dependence: a mutual information approach
- Copula theory and probabilistic sensitivity analysis: is there a connection?
- Multivariate concordance
- Information indices: Unification and applications.
- On the recovery of joint distributions from limited information
- Entropy and predictability of stock market returns.
- Nonparametric density estimation applied to population pharmacokinetics
- Information theory, model error, and predictive skill of stochastic models for complex nonlinear systems
- Generating random correlation matrices with fixed values: an application to the evaluation of multivariate surrogate endpoints
- Bayesian multivariate sparse functional principal components analysis with application to longitudinal microbiome multiomics data
- On a multivariate copula-based dependence measure and its estimation
- An efficient algorithm to assess multivariate surrogate endpoints in a causal inference framework
- Coordinate-wise transformation of probability distributions to achieve a Stein-type identity
- Nonlinear dependencies on Brazilian equity network from mutual information minimum spanning trees
- Robust equilibrium strategies in a defined benefit pension plan game
- A measure of mutual complete dependence
- Cumulants of multiinformation density in the case of a multivariate normal distribution
- Measuring the asymmetric contributions of individual subsystems
- Hierarchical clustering of continuous variables based on the empirical copula process and permutation linkages
- Measuring stochastic dependence using \(\phi\)-divergence
- Mathematical properties of the multivariate \(t\) distribution
- Entropy correlation coefficient for measuring predictive power of generalized linear models
- Testing conditional multivariate rank correlations: the effect of institutional quality on factors influencing competitiveness
- An information-theoretic approach for the evaluation of surrogate endpoints based on causal inference
- Conditional association
- A non-parametric independence test using permutation entropy
- Lorenz zonoids and dependence measures: a proposal
- A symbolic test for testing independence between time series
- scientific article; zbMATH DE number 992392 (Why is no real title available?)
- Measures of multivariate association and dependence
- COPULA-BASED CHARACTERIZATIONS FOR HIGHER ORDER MARKOV PROCESSES
- scientific article; zbMATH DE number 3858149 (Why is no real title available?)
- scientific article; zbMATH DE number 3879799 (Why is no real title available?)
- A new multivariate measure of association for nominal independent variable
- Information dependency: strong consistency of Darbellay-Vajda partition estimators
- scientific article; zbMATH DE number 46136 (Why is no real title available?)
- Comparison, utility, and partition of dependence under absolutely continuous and singular distributions
- Linear dependence structure of the entropy space
- Measures of dependence for the multivariate t distribution with applications to the stock market
- USING THE MUTUAL INFORMATION COEFFICIENT TO IDENTIFY LAGS IN NONLINEAR MODELS
- An R2criterion based on optimal predictors
- Mutual information and redundancy for categorical data
- A robust-equitable measure for feature ranking and selection
- Multivariate mutual information
- Entropy measure for the quantification of upper quantile interdependence in multivariate distributions
- Nonlinear Laplacian spectral analysis: capturing intermittent and low‐frequency spatiotemporal patterns in high‐dimensional data
- The essential dependence for a group of random vectors
- Multi-variate correlation and mixtures of product measures.
- A note on learning dependence under severe uncertainty
- On generalized measures of entropy and dependence
- Dimensionless Measures of Variability and Dependence for Multivariate Continuous Distributions
- A Procedure for Identification of Principal Variables by Least Generalized Dependence
- Information measures of kernel estimation
- An efficient integrated nonparametric entropy estimator of serial dependence
- On measurement of stochastic dependence in multivariate data
- A multivariate version of Hoeffding's phi-square
- Identifying individual predictive factors for treatment efficacy
- On mathematical optimization for clustering categories in contingency tables
- Test of bivariate independence based on angular probability integral transform with emphasis on circular-circular and circular-linear data
- The Berkelmans–Pries dependency function: A generic measure of dependence between random variables
- Testing bivariate independence based on α -divergence by improved probit transformation method for copula density estimation
- Concentration inequality of sums of dependent subexponential random variables and application to bounds for value-at-risk
- Measures of conditional dependence for nonlinearity, asymmetry and beyond
- Information measures in perspective
- On the relationship between association and surrogacy when both the surrogate and true endpoint are binary outcomes
- An information-theoretic approach for the assessment of a continuous outcome as a surrogate for a binary true endpoint based on causal inference: application to vaccine evaluation
- A survey of some recent developments in measures of association
- Assessing a surrogate predictive value: a causal inference approach
- Evaluating time-to-event surrogates for time-to-event true endpoints: an information-theoretic approach based on causal inference
- On a general theoretical framework of reliability
- Intrinsic credible regions: an objective Bayesian approach to interval estimation (with comments and rejoinder)
- Estimation of entropy and other functionals of a multivariate density
- Multivariate maximum entropy identification, transformation, and dependence
- On some entropy and divergence type measures of variability and dependence for mixed continuous and discrete variables
- Agglomerative hierarchical clustering of continuous variables based on mutual information
- Relevance measures for subset variable selection in regression problems based on \(k\)-additive mutual information
- Mining and visualising ordinal data with non-parametric continuous BBNs
This page was built for publication: Relative Entropy Measures of Multivariate Dependence
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3833444)