Learning and generalization with the information bottleneck

DOI10.1016/J.TCS.2010.04.006MaRDI QIDQ982641zbMATH OpenOpenAlexFDO

Authors Ohad Shamir, Sivan Sabato, Naftali Tishby

Publication date 7 July 2010

Published in Theoretical Computer Science (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.tcs.2010.04.006

zbMATH Keywords

information theoryinformation bottlenecksufficient statisticsstatistical learning theory

Mathematics Subject Classification ID

Computational learning theory (68Q32)

Recommendations

• Learning and Generalization with the Information Bottleneck
• An information theoretic tradeoff between complexity and accuracy.
• Multivariate Information Bottleneck
• Gaussian lower bound for the information bottleneck limit
• The deterministic information bottleneck

Cites work

• scientific article; zbMATH DE number 5957257 (Why is no real title available?)
• scientific article; zbMATH DE number 3145638 (Why is no real title available?)
• scientific article; zbMATH DE number 4170917 (Why is no real title available?)
• scientific article; zbMATH DE number 107482 (Why is no real title available?)
• scientific article; zbMATH DE number 3365044 (Why is no real title available?)
• scientific article; zbMATH DE number 3063453 (Why is no real title available?)
• An information theoretic tradeoff between complexity and accuracy.
• Convergence properties of functional estimates for discrete distributions
• Estimation of Entropy and Mutual Information
• Feature extraction. Foundations and applications. Papers from NIPS 2003 workshop on feature extraction, Whistler, BC, Canada, December 11--13, 2003. With CD-ROM.
• Information-based clustering
• On Information and Sufficiency

Cited in

(17)

• Statistical criticality arises in most informative representations
• The mathematical structure of information bottleneck methods
• The role of mutual information in variational classifiers
• Multivariate Information Bottleneck
• Maximal relevance and optimal learning machines
• INFORMATION BOTTLENECKS, CAUSAL STATES, AND STATISTICAL RELEVANCE BASES: HOW TO REPRESENT RELEVANT INFORMATION IN MEMORYLESS TRANSDUCTION
• Learning and Generalization with the Information Bottleneck
• scientific article; zbMATH DE number 7415108 (Why is no real title available?)
• Applying the information bottleneck to statistical relational learning
• Understanding Deep Learning with Statistical Relevance
• On the information bottleneck theory of deep learning
• An information theoretic tradeoff between complexity and accuracy.
• Neural network coding of natural images with applications to pure mathematics
• The information complexity of learning tasks, their structure and their distance
• scientific article; zbMATH DE number 5957255 (Why is no real title available?)
• The deterministic information bottleneck
• Gaussian lower bound for the information bottleneck limit

This page was built for publication: Learning and generalization with the information bottleneck

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q982641)