Estimating Entropy Rates with Bayesian Confidence Intervals

DOI10.1162/0899766053723050MaRDI QIDQ3025070zbMATH OpenOpenAlexWikidataFDO

Authors Matthew B. Kennel, Jonathon Shlens, Henry D. I. Abarbanel, E. J. Chichilnisky

Publication date 4 July 2005

Published in Neural Computation (Search for Journal in Brave)

Full work available at URL https://escholarship.org/uc/item/9243v6dr

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Bayesian inference (62F15) Parametric tolerance and confidence regions (62F25) Monte Carlo methods (65C05) Neural biology (92C20)

Recommendations

• Estimating Information Rates with Confidence Intervals in Neural Spike Trains
• A continuous entropy rate estimator for spike trains using a K-means-based context tree
• Estimating the Temporal Interval Entropy of Neuronal Discharge
• Estimating the Entropy Rate of Spike Trains via Lempel-Ziv Complexity
• A simple method for estimating the entropy of neural activity

Cites work

• A formal theory of inductive inference. Part I
• A Mathematical Theory of Communication
• A universal algorithm for sequential data compression
• Compression of individual sequences via variable-rate coding
• Entropy estimation of symbol sequences
• Estimating the Entropy Rate of Spike Trains via Lempel-Ziv Complexity
• Estimating the errors on measured entropy and mutual information
• Estimation of Entropy and Mutual Information
• Geodesic Entropic Graphs for Dimension and Entropy Estimation in Manifold Learning
• scientific article; zbMATH DE number 1505858 (Why is no real title available?)
• Linear Time Universal Coding and Time Reversal of Tree Sources Via FSM Closure
• Metric-space analysis of spike trains: theory, algorithms and application
• Monte Carlo sampling methods using Markov chains and their applications
• Nonparametric entropy estimation for stationary processes and random fields, with applications to English text
• On the Complexity of Finite Sequences
• On the role of pattern matching in information theory
• Predictability, complexity, and learning
• Statistical Inference, Occam's Razor, and Statistical Mechanics on the Space of Probability Distributions
• The context-tree weighting method: basic properties
• The context-tree weighting method: extensions
• The performance of universal encoding
• Universal Compression of Memoryless Sources Over Unknown Alphabets

Cited in

(23)

• Synergy, redundancy, and multivariate information measures: an experimentalist's perspective
• On the permutation entropy Bayesian estimation
• Information processing in the LGN: a comparison of neural codes and cell types
• The permutation entropy rate equals the metric entropy rate for ergodic information sources and ergodic dynamical systems
• Model-based decoding, information estimation, and change-point detection techniques for multineuron spike trains
• A simple method for estimating the entropy of neural activity
• Variance estimators for the Lempel-Ziv entropy rate estimator
• Indices for Testing Neural Codes
• A continuous entropy rate estimator for spike trains using a K-means-based context tree
• Information in the Nonstationary Case
• Optimal instruments and models for noisy chaos
• Coincidences and estimation of entropies of random variables with large cardinalities
• scientific article; zbMATH DE number 6951407 (Why is no real title available?)
• Estimating the Entropy Rate of Spike Trains via Lempel-Ziv Complexity
• Estimating the Temporal Interval Entropy of Neuronal Discharge
• Information theory in neuroscience
• Information-geometric measure of 3-neuron firing patterns characterizes scale-dependence in cortical networks
• A locally optimal algorithm for estimating a generating partition from an observed time series and its application to anomaly detection
• A Finite-Sample, Distribution-Free, Probabilistic Lower Bound on Mutual Information
• Tight Data-Robust Bounds to Mutual Information Combining Shuffling and Model Selection Techniques
• Estimating Information Rates with Confidence Intervals in Neural Spike Trains
• Bayesian and quasi-Bayesian estimators for mutual information from discrete data
• Predicting the synaptic information efficacy in cortical layer 5 pyramidal neurons using a minimal integrate-and-fire model

This page was built for publication: Estimating Entropy Rates with Bayesian Confidence Intervals

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3025070)