Entropic Inequalities and Marginal Problems
From MaRDI portal
Abstract: A marginal problem asks whether a given family of marginal distributions for some set of random variables arises from some joint distribution of these variables. Here we point out that the existence of such a joint distribution imposes non-trivial conditions already on the level of Shannon entropies of the given marginals. These entropic inequalities are necessary (but not sufficient) criteria for the existence of a joint distribution. For every marginal problem, a list of such Shannon-type entropic inequalities can be calculated by Fourier-Motzkin elimination, and we offer a software interface to a Fourier-Motzkin solver for doing so. For the case that the hypergraph of given marginals is a cycle graph, we provide a complete analytic solution to the problem of classifying all relevant entropic inequalities, and use this result to bound the decay of correlations in stochastic processes. Furthermore, we show that Shannon-type inequalities for differential entropies are not relevant for continuous-variable marginal problems; non-Shannon-type inequalities are, both in the discrete and in the continuous case. In contrast to other approaches, our general framework easily adapts to situations where one has additional (conditional) independence requirements on the joint distribution, as in the case of graphical models. We end with a list of open problems. A complementary article discusses applications to quantum nonlocality and contextuality.
Recommendations
- Entropy and variational problems
- On a generalization of the entropy inequality
- Entropy of spherical marginals and related inequalities
- Some inequalities on generalized entropies
- Inequalities related to some types of entropies and divergences
- Around the entropic talagrand inequality
- ON SOME INEQUALITIES AND GENERALIZED ENTROPIES: A UNIFIED APPROAC
- Inequalities for generalized entropy and optimal transportation
- scientific article; zbMATH DE number 878238
- scientific article; zbMATH DE number 4031564
Cited in
(26)- From entropy-maximization to equality-maximization: Gauss, Laplace, Pareto, and Subbotin
- Compatibility, desirability, and the running intersection property
- Inequalities related to some types of entropies and divergences
- Entropies, majorization flow, and continuity bounds
- A combinatorial approach to nonlocality and contextuality
- Bell length in the entanglement geometry
- Polynomial Bell inequalities
- On generalized entropies and information-theoretic Bell inequalities under decoherence
- An exactly solvable ansatz for statistical mechanics models
- Theory-independent limits on correlations from generalized Bayesian networks
- Realisability conditions for second-order marginals of biphased media
- scientific article; zbMATH DE number 1360906 (Why is no real title available?)
- scientific article; zbMATH DE number 508750 (Why is no real title available?)
- Computational tools for solving a marginal problem with applications in Bell non-locality and causal modeling
- Analysing causal structures with entropy
- Multi-variate correlation and mixtures of product measures.
- Causal structures from entropic information: geometry and novel scenarios
- Further results on generalized conditional entropies
- On an extension problem for density matrices
- Entropic Conditions and Hedging
- Wald, QLR, and score tests when parameters are subject to linear inequality constraints
- The entropic approach to causal correlations
- The logical structure of contextuality and nonclassicality
- Mapping the frontier: a review of quantum and evolutionary game theory for complex decision-making
- Efficient detection of redundancies in systems of linear inequalities
- Efficient detection of redundancies in systems of linear inequalities
This page was built for publication: Entropic Inequalities and Marginal Problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2989400)
