Relations between entropy and error probability

DOI10.1109/18.272494zbMATH Open0802.94004OpenAlexW2099294566MaRDI QIDQ4307306FDOQ4307306

Neri Merhav, Meir Feder

Publication date: 4 October 1994

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL: https://semanticscholar.org/paper/3c0e6c724fcd9f76182efae5d2b1fd0de6f1bd44

zbMATH Keywords

entropyconditional entropyupper boundpredictabilityequivocationdiscrete memoryless channelschannel coding theoremminimal error probability

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Error probability in coding theory (94B70)

Cited In (14)

• A fast separability-based feature-selection method for high-dimensional remotely sensed image classification
• Using a VOM model for reconstructing potential coding regions in EST sequences
• Identification and Prediction
• Generalized information criteria for Bayes decisions
• Joint Markov blankets in feature sets extracted from wavelet packet decompositions
• Information diagrams in the study of entanglement in symmetric multi-qudit systems and applications to quantum phase transitions in Lipkin-Meshkov-Glick \(D\)-level atom models
• Increasing and decreasing returns and losses in mutual information feature subset selection
• Title not available (Why is that?)
• Quantifying Stimulus Discriminability: A Comparison of Information Theory and Ideal Observer Analysis
• Further results on generalized conditional entropies
• Title not available (Why is that?)
• Using entropy for quantitative measurement of operational complexity of supplier-customer system: case studies
• Measuring the efficiency of the intraday Forex market with a universal data compression algorithm
• Convexity inequalities for estimating generalized conditional entropies from below

   Recommendations

• The error probability, entropy, and equivocation when the number of input messages increases 👍 👎
• Lower bounds to error probability for coding on discrete memoryless channels. I 👍 👎
• Title not available (Why is that?) 👍 👎
• On one extreme value problem for entropy and error probability 👍 👎
• On some upper bounds for the probability of error 👍 👎

This page was built for publication: Relations between entropy and error probability

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4307306)