Entropy and effective support size (Q925758): Difference between revisions
From MaRDI portal
Set profile property. |
Set OpenAlex properties. |
||
| Property / full work available at URL | |||
| Property / full work available at URL: https://doi.org/10.3390/e8030169 / rank | |||
Normal rank | |||
| Property / OpenAlex ID | |||
| Property / OpenAlex ID: W2076284810 / rank | |||
Normal rank | |||
Revision as of 02:19, 20 March 2024
scientific article
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | Entropy and effective support size |
scientific article |
Statements
Entropy and effective support size (English)
0 references
22 May 2008
0 references
Summary: Notion of Effective size of support (Ess) of a random variable is introduced. A small set of natural requirements that a measure of Ess should satisfy is presented. The measure with prescribed properties is in a direct (exp-) relationship to the family of Rényi's - entropies which includes also Shannon's entropy \(H\). Considerations of choice of the value of imply that exp(\(H\)) appears to be the most appropriate measure of Ess. Entropy and Ess can be viewed thanks to their log/exp relationship as two aspects of the same thing. In Probability and Statistics the Ess aspect could appear more basic than the entropic one.
0 references
Rényi's entropy
0 references
Shannon's entropy
0 references
support
0 references
interpretation
0 references
probability
0 references
statistics
0 references
