Entropy and data compression schemes

DOI10.1109/18.179344MaRDI QIDQ4034433zbMATH OpenOpenAlexWikidataFDO

Authors Donald S. Ornstein, Benjamin Weiss

Publication date 16 May 1993

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1109/18.179344

zbMATH Keywords

entropydata compressionShannon-McMillan-Breiman theoremLempel-Ziv parsingstationary ergodic process

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Source coding (94A29)

Recommendations

• Some asymptotic properties of the entropy of a stationary ergodic data source with applications to data compression
• Redundancy estimates for the Lempel–Ziv algorithm of data compression
• Exact analysis of the Lempel-Ziv algorithm for i.i.d. sources
• The entropy theorem via coding bounds
• Compression and entropy

Cited in

(92)

• Generalized dimensions, large deviations and the distribution of rare events
• Dimension of sets of sequences defined in terms of recurrence of their prefixes
• Some asymptotic properties of the entropy of a stationary ergodic data source with applications to data compression
• FLUCTUATIONS OF THE METRIC ENTROPY FOR MIXING MEASURES
• Exponential law for random subshifts of finite type
• Entry and return times distribution
• Entropy inequalities for semigroup actions
• The measure and dimension of the first return exceptional sets of finite type
• Entrance time and Rényi entropy
• Convergence of recurrence of blocks for mixing processes
• Recurrence speed of multiples of an irrational number.
• Some remarks on filtering and prediction of stationary processes
• Statistics of Poincaré recurrences for a class of smooth circle maps
• Return times, recurrence densities and entropy for actions of some discrete amenable groups
• Compression and entropy
• scientific article; zbMATH DE number 3983063 (Why is no real title available?)
• Entropy and prefixes
• A Central Limit Theorem for Non-Overlapping Return Times
• Diophantine properties of iets and general systems: quantitative proximality and connectivity
• On the recurrence rates of continued fractions
• Correlation decay and recurrence asymptotics for some robust nonuniformly hyperbolic maps
• Return time complexity of Sturmian sequences
• String matching bounds via coding
• The spectrum of Poincaré recurrence
• Quantitative recurrence in two-dimensional extended processes
• Pressure and escape rates for random subshifts of finite type
• Restricted sensitivity, return time and entropy in Feldman–Katok and mean metrics
• Diophantine approximation by orbits of expanding Markov maps
• The almost sure invariance principle for beta-mixing measures
• Topological and almost Borel universality for systems with the weak specification property
• Eulerian entropy and non-repetitive subword complexity
• Coalescence and meeting times on \(n\)-block Markov chains
• The upper capacity topological entropy of free semigroup actions for certain non-compact sets
• Optimal data compression algorithm
• On optimal parsing for LZ78-like compressors
• Non-sequential recursive pair substitution: some rigorous results
• The multifractal spectra for the recurrence rates of beta-transformations
• Quantitative uniform hitting in exponentially mixing systems
• Quantitative recurrence properties and homogeneous self-similar sets
• More on recurrence and waiting times
• Return-time -spectrum for equilibrium states with potentials of summable variation
• Entropy and compression: a simple proof of an inequality of Khinchin-Ornstein-Shields
• Best approximation of orbits in iterated function systems
• The recurrence time for irrational rotations
• ?-Entropy data compression
• Epsilon Entropy and Data Compression
• Measure-theoretic metric mean dimension
• Estimation of muscle spindle information rate by pattern matching and the effect of gamma system activity on parallel spindles
• Topological pressure of Poincaré recurrence set
• Recurrence rates for observations of flows
• Generic continuous spectrum for ergodic Schrödinger operators
• Random subshifts of finite type
• Intermittent estimation of stationary time series
• The recurrence spectrum for dynamical systems beyond specification
• Zero-one law of Hausdorff dimensions of the recurrent sets
• Central limit theorem behavior in the skew tent map
• BIAS REDUCTION OF THE NEAREST NEIGHBOR ENTROPY ESTIMATOR
• On universal algorithms for classifying and predicting stationary processes
• Universal Data Compression Algorithm Based on Approximate String Matching
• The multifractal spectra of certain planar recurrence sets in the continued fraction dynamical system
• Skew products, quantitative recurrence, shrinking targets and decay of correlations
• Thin annuli property and exponential distribution of return times for weakly Markov systems
• Relative entropy via non-sequential recursive pair substitution
• Statistical mechanics of the data compression theorem
• Some remarks on the notion of Bohr chaos and invariant measures
• Mismatched codebooks and the role of entropy coding in lossy data compression
• Sharp error terms for return time statistics under mixing conditions
• The waiting spectra of the sets described by the quantitative waiting time indicators
• Internal Compression of Protocols to Entropy
• Non-parametric change-point estimation using string matching algorithms
• Information meaning of entropy of nonergodic measures
• Ergodic universality of some topological dynamical systems
• Limit results on pattern entropy
• Quantitative Poincaré recurrence in continued fraction dynamical system
• Local dimensions for Poincaré recurrences
• AN INTRODUCTION TO QUANTITATIVE POINCARÉ RECURRENCE IN DYNAMICAL SYSTEMS
• Dimensions of recurrent sets in \(\beta\)-symbolic dynamics
• Hausdorff dimensions of recurrent and shrinking target sets under Lipschitz functions for expanding Markov maps
• On processes which cannot be distinguished by finite observation
• Recurrence times, waiting times and universal entropy production estimators
• Entry times distribution for dynamical balls on metric spaces
• Neural tangent kernel analysis to probe convergence in physics-informed neural solvers: PIKANs vs. PINNs
• The central limit theorem for uniformly strong mixing measures
• ON THE STATISTICAL DISTRIBUTION OF FIRST-RETURN TIMES OF BALLS AND CYLINDERS IN CHAOTIC SYSTEMS
• Repetition and recurrence times: dual statements and summable mixing rates
• The first return time properties of an irrational rotation
• Entropy structure
• Entropy and distinct parsing for ergodic sources
• The first return time test of pseudorandom numbers
• scientific article; zbMATH DE number 3893089 (Why is no real title available?)
• The global statistics of return times: Return time dimensions versus generalized measure dimensions
• Matching strings in encoded sequences

This page was built for publication: Entropy and data compression schemes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4034433)