Wasserstein Continuity of Entropy and Outer Bounds for Interference Channels

DOI10.1109/TIT.2016.2562630MaRDI QIDQ2976706zbMATH OpenFDO

Authors Yury Polyanskiy, Yihong Wu

Publication date 28 April 2017

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1504.04419

Mathematics Subject Classification ID

Variational problems in a geometric measure-theoretic setting (49Q20) Inequalities; stochastic orderings (60E15) Information theory (general) (94A15) Measures of information, entropy (94A17) Channel models (including quantum) in information and communication theory (94A40)

Abstract: It is shown that under suitable regularity conditions, differential entropy is a Lipschitz functional on the space of distributions on $n$-dimensional Euclidean space with respect to the quadratic Wasserstein distance. Under similar conditions, (discrete) Shannon entropy is shown to be Lipschitz continuous in distributions over the product space with respect to Ornstein's $$-distance (Wasserstein distance corresponding to the Hamming distance). These results together with Talagrand's and Marton's transportation-information inequalities allow one to replace the unknown multi-user interference with its i.i.d. approximations. As an application, a new outer bound for the two-user Gaussian interference channel is proved, which, in particular, settles the "missing corner point" problem of Costa (1985).

Recommendations

• \(\varepsilon\)-entropy, \(\varepsilon\)-rate, and interpolation spaces revisited with an application to linear communication channels
• Entropy inequalities for discrete channels
• Capacity Bounds for the Gaussian Interference Channel
• Mutual Information of Wireless Channels and Block-Jacobi Ergodic Operators
• Concentration of measure inequalities in information theory, communications, and coding
• Analysis of Deterministic Binary Interference Channels Via a General Outer Bound
• scientific article; zbMATH DE number 3575467
• On the Rényi Divergence, Joint Range of Relative Entropies, and a Channel Coding Theorem
• On weak convergence of probability measures, channel capacity and code error probabilities
• A New Outer Bound and the Noisy-Interference Sum–Rate Capacity for Gaussian Interference Channels

Cited in

(8)

• Unadjusted Langevin algorithm for sampling a mixture of weakly smooth potentials
• Stochastic gradient Hamiltonian Monte Carlo for non-convex learning
• Maximal power output of a stochastic thermodynamic engine
• The Wasserstein distance of order 1 for quantum spin systems on infinite lattices
• Sharp convergence rates for empirical optimal transport with smooth costs
• Limit distribution theory for smooth \(p\)-Wasserstein distances
• Statistical inference with regularized optimal transport
• Rate of convergence of the smoothed empirical Wasserstein distance

This page was built for publication: Wasserstein Continuity of Entropy and Outer Bounds for Interference Channels

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2976706)