Entropy estimates of small data sets
From MaRDI portal
Abstract: Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon, R'enyi and Tsallis) specially devised to provide a compromise between low bias and small statistical errors, for short data series. This new estimator out-performs other currently available ones when the data sets are small and the probabilities of the possible outputs of the random variable are not close to zero. Otherwise, other well-known estimators remain a better choice. The potential range of applicability of this estimator is quite broad specially for biological and digital data series.
Recommendations
- On the estimation of entropy
- On the estimation of entropy for non-negative data
- On the entropy estimators
- A note on entropy estimation
- Entropy estimators‐improvements and comparisons
- Estimating Entropy over Data Streams
- Information theoretic methods in small domain estimation
- Estimation of entropy using random sampling
Cited in
(18)- Improving quality of sample entropy estimation for continuous distribution probability functions
- Distinguishing stationary/nonstationary scaling processes using wavelet Tsallis \(q\)-entropies
- Investigation on the high-order approximation of the entropy bias
- Recurrence times, waiting times and universal entropy production estimators
- Mutual information as a two-point correlation function in stochastic lattice models
- Statistical criticality arises in most informative representations
- Coincidences and estimation of entropies of random variables with large cardinalities
- Bayes' estimators of generalized entropies
- Estimating entropy rate from censored symbolic time series: A test for time-irreversibility
- Investigation on the running-in quality at different rotating speeds by chaos theory
- Modified correlation entropy estimation for a noisy chaotic time series
- Scaling invariance embedded in very short time series: a factorial moment based diffusion entropy approach
- Non-sequential recursive pair substitutions and numerical entropy estimates in symbolic dynamical systems
- Chaotic time series analysis: a view of transition networks
- Estimating Shannon's entropy with incomplete species inventories
- Information-theoretic analysis of temporal dependence in discrete stochastic processes: application to precipitation predictability
- Estimating Tsallis entropy of several exponentially distributed populations
- Minimum mutual information and non-Gaussianity through the maximum entropy method: estimation from finite samples
This page was built for publication: Entropy estimates of small data sets
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3503764)
