Learning and generalization with the information bottleneck

DOI10.1016/J.TCS.2010.04.006zbMATH Open1192.68395OpenAlexW2123469175MaRDI QIDQ982641FDOQ982641

Authors: Ohad Shamir, Sivan Sabato, Naftali Tishby 

Publication date: 7 July 2010

Published in: Theoretical Computer Science (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.tcs.2010.04.006

Recommendations

• Learning and Generalization with the Information Bottleneck
• An information theoretic tradeoff between complexity and accuracy.
• Multivariate Information Bottleneck
• Gaussian lower bound for the information bottleneck limit
• The deterministic information bottleneck

zbMATH Keywords

information theoryinformation bottlenecksufficient statisticsstatistical learning theory

Mathematics Subject Classification ID

Computational learning theory (68Q32)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• On Information and Sufficiency
• Title not available (Why is that?)
• Title not available (Why is that?)
• Estimation of Entropy and Mutual Information
• Title not available (Why is that?)
• Title not available (Why is that?)
• Convergence properties of functional estimates for discrete distributions
• Feature extraction. Foundations and applications. Papers from NIPS 2003 workshop on feature extraction, Whistler, BC, Canada, December 11--13, 2003. With CD-ROM.
• Information-based clustering
• An information theoretic tradeoff between complexity and accuracy.

Cited In (17)

• The role of mutual information in variational classifiers
• The mathematical structure of information bottleneck methods
• Multivariate Information Bottleneck
• Maximal relevance and optimal learning machines
• INFORMATION BOTTLENECKS, CAUSAL STATES, AND STATISTICAL RELEVANCE BASES: HOW TO REPRESENT RELEVANT INFORMATION IN MEMORYLESS TRANSDUCTION
• Learning and Generalization with the Information Bottleneck
• Title not available (Why is that?)
• Applying the information bottleneck to statistical relational learning
• Understanding Deep Learning with Statistical Relevance
• On the information bottleneck theory of deep learning
• An information theoretic tradeoff between complexity and accuracy.
• Neural network coding of natural images with applications to pure mathematics
• The information complexity of learning tasks, their structure and their distance
• Title not available (Why is that?)
• The deterministic information bottleneck
• Gaussian lower bound for the information bottleneck limit
• Statistical criticality arises in most informative representations

This page was built for publication: Learning and generalization with the information bottleneck

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q982641)