No label defined (Q3753919)
From MaRDI portal
!
This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:
scientific article; zbMATH DE number 3991410
| Language | Label | Description | Also known as |
|---|---|---|---|
| default for all languages | No label defined |
||
| English | No label defined |
scientific article; zbMATH DE number 3991410 |
Statements
1986
0 references
relative entropy
0 references
probabilistic inference
0 references
artificial intelligence
0 references
0.7345141172409058
0 references
0.7157121896743774
0 references
0.7045497298240662
0 references
0.6986759901046753
0 references
[For the entire collection see Zbl 0595.00024.] The relative entropy is an information-theoretic measure of the dissimilarity between two probability distributions. Various properties of relative entropy have led to its widespread use in information theory. These properties suggest that relative entropy has a role to play in systems that attempt to perform inference in terms of probability distributions. The paper reviews some basic properties of relative entropy as well as its role in probabilistic inference. The paper points out three areas in artificial intelligence (AI), where relative entropy should have a role to play. 1. Quantifying information gains and losses. 2. Probabilistic inferencing. 3. Searching large state spaces.
0 references