Information theory. From coding to learning (to appear)

MaRDI QIDQ6579859zbMATH OpenFDO

Authors Yury Polyanskiy, Yihong Wu

Publication date 29 July 2024

zbMATH Keywords

statistical learning\(f\)-divergencesstrong data processing inequalitiesentropic upper bounds for statistical estimationKolmogorov's metric entropyPAC Bayes and variational principle

Mathematics Subject Classification ID

Applications of statistics in engineering and industry; control charts (62P30) Learning and adaptive systems in artificial intelligence (68T05) Information theory (general) (94A15) Measures of information, entropy (94A17) Introductory exposition (textbooks, tutorial papers, etc.) pertaining to information and communication theory (94-01)

Recommendations

• Elements of Information Theory
• An introduction to single-user information theory
• Information theory. Coding theorems for discrete memoryless systems
• Information theory and coding by example
• Probability and Information

Cited in

(1)

• Exercises in applied mathematics. With a view toward information theory, machine learning, wavelets, and statistical physics

This page was built for publication: Information theory. From coding to learning (to appear)

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6579859)