Relations between entropy and error probability

DOI10.1109/18.272494MaRDI QIDQ4307306zbMATH OpenOpenAlexFDO

Authors Meir Feder, Neri Merhav

Publication date 4 October 1994

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://semanticscholar.org/paper/3c0e6c724fcd9f76182efae5d2b1fd0de6f1bd44

zbMATH Keywords

entropyconditional entropyupper boundpredictabilityequivocationdiscrete memoryless channelschannel coding theoremminimal error probability

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Error probability in coding theory (94B70)

Recommendations

• The error probability, entropy, and equivocation when the number of input messages increases
• Lower bounds to error probability for coding on discrete memoryless channels. I
• scientific article; zbMATH DE number 3601519
• On one extreme value problem for entropy and error probability
• On some upper bounds for the probability of error

Cited in

(19)

• A fast separability-based feature-selection method for high-dimensional remotely sensed image classification
• Using a VOM model for reconstructing potential coding regions in EST sequences
• Joint Markov blankets in feature sets extracted from wavelet packet decompositions
• Generalized information criteria for Bayes decisions
• Identification and Prediction
• Information diagrams in the study of entanglement in symmetric multi-qudit systems and applications to quantum phase transitions in Lipkin-Meshkov-Glick \(D\)-level atom models
• Increasing and decreasing returns and losses in mutual information feature subset selection
• Quantifying Stimulus Discriminability: A Comparison of Information Theory and Ideal Observer Analysis
• Further results on generalized conditional entropies
• scientific article; zbMATH DE number 2208449 (Why is no real title available?)
• Using entropy for quantitative measurement of operational complexity of supplier-customer system: case studies
• Joint range of Rényi entropies
• Measuring the efficiency of the intraday Forex market with a universal data compression algorithm
• Trustworthy representation learning via information funnels and bottlenecks
• Predictability of complex systems
• On one extreme value problem for entropy and error probability
• scientific article; zbMATH DE number 3601519 (Why is no real title available?)
• Convexity inequalities for estimating generalized conditional entropies from below
• Uncertainty relations in terms of generalized entropies derived from information diagrams

This page was built for publication: Relations between entropy and error probability

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4307306)