Entropy and data compression schemes

DOI10.1109/18.179344MaRDI QIDQ4034433zbMATH OpenOpenAlexWikidataFDO

Authors Donald S. Ornstein, Benjamin Weiss

Publication date 16 May 1993

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1109/18.179344

zbMATH Keywords

data compressionentropyLempel-Ziv parsingShannon-McMillan-Breiman theoremstationary ergodic process

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Source coding (94A29)

Recommendations

• Some asymptotic properties of the entropy of a stationary ergodic data source with applications to data compression
• Redundancy estimates for the Lempel–Ziv algorithm of data compression
• Exact analysis of the Lempel-Ziv algorithm for i.i.d. sources
• The entropy theorem via coding bounds
• Compression and entropy

Cited in

(95)

• Correlation decay and recurrence asymptotics for some robust nonuniformly hyperbolic maps
• Sharp error terms for return time statistics under mixing conditions
• Return times, recurrence densities and entropy for actions of some discrete amenable groups
• Entropy and prefixes
• String matching bounds via coding
• More on recurrence and waiting times
• The first return time test of pseudorandom numbers
• On optimal parsing for LZ78-like compressors
• Dimensions of recurrent sets in \(\beta\)-symbolic dynamics
• Statistics of Poincaré recurrences for a class of smooth circle maps
• Optimal data compression algorithm
• On the recurrence rates of continued fractions
• Best approximation of orbits in iterated function systems
• On universal algorithms for classifying and predicting stationary processes
• Matching strings in encoded sequences
• Entropy and compression: a simple proof of an inequality of Khinchin-Ornstein-Shields
• Generalized dimensions, large deviations and the distribution of rare events
• Information meaning of entropy of nonergodic measures
• The almost sure invariance principle for beta-mixing measures
• Diophantine properties of iets and general systems: quantitative proximality and connectivity
• Intermittent estimation of stationary time series
• Entry times distribution for dynamical balls on metric spaces
• Dimension of sets of sequences defined in terms of recurrence of their prefixes
• Estimation of muscle spindle information rate by pattern matching and the effect of gamma system activity on parallel spindles
• Non-parametric change-point estimation using string matching algorithms
• The upper capacity topological entropy of free semigroup actions for certain non-compact sets
• Recurrence times, waiting times and universal entropy production estimators
• Ergodic universality of some topological dynamical systems
• Skew products, quantitative recurrence, shrinking targets and decay of correlations
• Quantitative uniform hitting in exponentially mixing systems
• Coalescence and meeting times on \(n\)-block Markov chains
• Entropy and distinct parsing for ergodic sources
• ?-Entropy data compression
• The central limit theorem for uniformly strong mixing measures
• Zero-one law of Hausdorff dimensions of the recurrent sets
• Topological and almost Borel universality for systems with the weak specification property
• Relative entropy via non-sequential recursive pair substitution
• Entrance time and Rényi entropy
• Some asymptotic properties of the entropy of a stationary ergodic data source with applications to data compression
• The first return time properties of an irrational rotation
• Mismatched codebooks and the role of entropy coding in lossy data compression
• Limit results on pattern entropy
• The spectrum of Poincaré recurrence
• ON THE STATISTICAL DISTRIBUTION OF FIRST-RETURN TIMES OF BALLS AND CYLINDERS IN CHAOTIC SYSTEMS
• AN INTRODUCTION TO QUANTITATIVE POINCARÉ RECURRENCE IN DYNAMICAL SYSTEMS
• scientific article; zbMATH DE number 3983063 (Why is no real title available?)
• The multifractal spectra for the recurrence rates of beta-transformations
• Exponential law for random subshifts of finite type
• Convergence of recurrence of blocks for mixing processes
• Random subshifts of finite type
• Quantitative Poincaré recurrence in continued fraction dynamical system
• Ergodic behavior of graph entropy
• Local dimensions for Poincaré recurrences
• Statistical mechanics of the data compression theorem
• Quantitative recurrence properties and homogeneous self-similar sets
• The multifractal spectra of certain planar recurrence sets in the continued fraction dynamical system
• FLUCTUATIONS OF THE METRIC ENTROPY FOR MIXING MEASURES
• The waiting spectra of the sets described by the quantitative waiting time indicators
• scientific article; zbMATH DE number 918233 (Why is no real title available?)
• Recurrence rates for observations of flows
• Diophantine approximation by orbits of expanding Markov maps
• Topological pressure of Poincaré recurrence set
• The measure and dimension of the first return exceptional sets of finite type
• Compression and entropy
• Thin annuli property and exponential distribution of return times for weakly Markov systems
• scientific article; zbMATH DE number 3893089 (Why is no real title available?)
• Pressure and escape rates for random subshifts of finite type
• Non-sequential recursive pair substitution: some rigorous results
• BIAS REDUCTION OF THE NEAREST NEIGHBOR ENTROPY ESTIMATOR
• Internal Compression of Protocols to Entropy
• Entry and return times distribution
• Universal Data Compression Algorithm Based on Approximate String Matching
• A Central Limit Theorem for Non-Overlapping Return Times
• Return time complexity of Sturmian sequences
• Epsilon Entropy and Data Compression
• Entropy inequalities for semigroup actions
• Restricted sensitivity, return time and entropy in Feldman–Katok and mean metrics
• Some remarks on the notion of Bohr chaos and invariant measures
• Hausdorff dimensions of recurrent and shrinking target sets under Lipschitz functions for expanding Markov maps
• Return-time -spectrum for equilibrium states with potentials of summable variation
• Repetition and recurrence times: dual statements and summable mixing rates
• Recurrence speed of multiples of an irrational number.
• Measure-theoretic metric mean dimension
• The recurrence spectrum for dynamical systems beyond specification
• Neural tangent kernel analysis to probe convergence in physics-informed neural solvers: PIKANs vs. PINNs
• The multifractal spectra for the recurrence rates of expanding Markov maps
• Eulerian entropy and non-repetitive subword complexity
• Some remarks on filtering and prediction of stationary processes
• Entropy structure
• The recurrence time for irrational rotations
• On processes which cannot be distinguished by finite observation
• Central limit theorem behavior in the skew tent map
• Generic continuous spectrum for ergodic Schrödinger operators
• The global statistics of return times: Return time dimensions versus generalized measure dimensions
• Quantitative recurrence in two-dimensional extended processes

This page was built for publication: Entropy and data compression schemes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4034433)