Estimation of Entropy and Mutual Information
From MaRDI portal
Recommendations
Cites work
- A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations
- Achieving information bounds in non and semiparametric models
- An Efron-Stein inequality for nonsymmetric statistics
- Consistency of data-driven histogram methods for density estimation and classification
- Convergence properties of functional estimates for discrete distributions
- Cramér-Rao type integral inequalities for general loss functions
- Estimation of the information by an adaptive partitioning of the observation space
- Geometrizing rates of convergence. II
- scientific article; zbMATH DE number 1164155 (Why is no real title available?)
- Limit theorems for the logarithm of sample spacings
- Minimax lower bounds and moduli of continuity
- On a Class of Problems Related to the Random Division of an Interval
- On Choosing and Bounding Probability Metrics
- On the mathematical foundations of learning
- On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
- Second-order noiseless source coding theorems
- The jackknife estimate of variance
- Weighted sums of certain dependent random variables
Cited in
(only showing first 100 items - show all)- On the estimation of entropy
- An empirical study of the maximal and total information coefficients and leading measures of dependence
- Non-parametric entropy estimators based on simple linear regression
- A unified definition of mutual information with applications in machine learning
- On ``A mutual information estimator with exponentially decaying bias
- Independent subspace analysis of the sea surface temperature variability: non-Gaussian sources and sensitivity to sampling and dimensionality
- Identification of sparse neural functional connectivity using penalized likelihood estimation and basis functions
- Synergy, redundancy, and multivariate information measures: an experimentalist's perspective
- Infragranular layers lead information flow during slow oscillations according to information directionality indicators
- Split-door criterion: identification of causal effects through auxiliary outcomes
- Efficient multivariate entropy estimation via \(k\)-nearest neighbour distances
- Statistical estimation of the Shannon entropy
- Sample complexity of the distinct elements problem
- Estimating the errors on measured entropy and mutual information
- Detecting and testing altered brain connectivity networks with \(k\)-partite network topology
- The impact of clean spark spread expectations on storage hydropower generation
- Topological features determining the error in the inference of networks using transfer entropy
- Investigation on the high-order approximation of the entropy bias
- A multivariate extension of mutual information for growing neural networks
- Understanding autoencoders with information theoretic concepts
- Causality and Bayesian network PDEs for multiscale representations of porous media
- Statistical estimation of mutual information for mixed model
- On the estimation of entropy for non-negative data
- Large-scale multiple inference of collective dependence with applications to protein function
- Information processing in the LGN: a comparison of neural codes and cell types
- Efficient feature selection using shrinkage estimators
- Optimal bandwidth selection for re-substitution entropy estimation
- Similarity of interspike interval distributions and information gain in a stationary neuronal firing
- Sublinear algorithms for approximating string compressibility
- Limit theorems for empirical Rényi entropy and divergence with applications to molecular diversity analysis
- Hybrid statistical estimation of mutual information and its application to information flow
- Encoding uncertainty in the hippocampus
- An improved estimator of Shannon entropy with applications to systems with memory
- Estimation bias in maximum entropy models
- A kernel-based calculation of information on a metric space
- Estimating functions of distributions defined over spaces of unknown size
- Non-parametric estimation of mutual information through the entropy of the linkage
- Entropic representation and estimation of diversity indices
- Robust sensitivity analysis for stochastic systems
- Entropy inference and the James-Stein estimator, with application to nonlinear gene association networks
- Dependency reduction with divisive normalization: justification and effectiveness
- Entropy estimation in Turing's perspective
- A mutual information-based k-sample test for discrete distributions
- Ordinal symbolic analysis and its application to biomedical recordings
- Equitability, mutual information, and the maximal information coefficient
- An automatic inequality prover and instance optimal identity testing
- Applying the multivariate time-rescaling theorem to neural population models
- Estimating Entropy Rates with Bayesian Confidence Intervals
- Model-based decoding, information estimation, and change-point detection techniques for multineuron spike trains
- Efficient Markov chain Monte Carlo methods for decoding neural spike trains
- Least-squares independent component analysis
- Understanding Policy Diffusion in the U.S.: An Information-Theoretical Approach to Unveil Connectivity Structures in Slowly Evolving Complex Systems
- A simple method for estimating the entropy of neural activity
- Convergence of Monte Carlo distribution estimates from rival samplers
- The Spike-Triggered Average of the Integrate-and-Fire Cell Driven by Gaussian White Noise
- Quadratic Tsallis entropy bias and generalized maximum entropy models
- A computationally efficient estimator for mutual information
- Variance estimators for the Lempel-Ziv entropy rate estimator
- Representation of Mutual Information Via Input Estimates
- Estimating Mutual Information Via Kolmogorov Distance
- Adaptive Design Optimization: A Mutual Information-Based Approach to Model Discrimination in Cognitive Science
- Justifying additive noise model-based causal discovery via algorithmic information theory
- How synaptic release probability shapes neuronal transmission: information-theoretic analysis in a cerebellar granule cell
- Information in the Nonstationary Case
- Calculation of information flow rate from mutual information
- Coincidences and estimation of entropies of random variables with large cardinalities
- Nonparametric estimation of information-based measures of statistical dispersion
- Geometric k-nearest neighbor estimation of entropy and mutual information
- Flow complexity in open systems: interlacing complexity index based on mutual information
- Information estimators for weighted observations
- Warped phase coherence: An empirical synchronization measure combining phase and amplitude information
- A robust-equitable measure for feature ranking and selection
- Estimation of the information by an adaptive partitioning of the observation space
- Estimating the Entropy Rate of Spike Trains via Lempel-Ziv Complexity
- Analyzing Neural Responses to Natural Signals: Maximally Informative Dimensions
- On an entropy conservation principle
- Statistical estimation of conditional Shannon entropy
- Renyi entropy estimation revisited
- Statistical mechanics of the US supreme court
- Information theory in neuroscience
- On directed information theory and Granger causality graphs
- Estimating the directed information to infer causal relationships in ensemble neural spike train recordings
- On the Kozachenko-Leonenko entropy estimator
- Quantifying information conveyed by large neuronal populations
- Information-theoretic bounds and approximations in neural population coding
- An information-theoretic approach to study spatial dependencies in small datasets
- Variational representations and neural network estimation of Rényi divergences
- A Finite-Sample, Distribution-Free, Probabilistic Lower Bound on Mutual Information
- Approximate profile maximum likelihood
- Evaluation of mutual information estimators for time series
- GENERALIZED CELLULAR NEURAL NETWORKS (GCNNs) CONSTRUCTED USING PARTICLE SWARM OPTIMIZATION FOR SPATIO-TEMPORAL EVOLUTIONARY PATTERN IDENTIFICATION
- Asymptotic normality for plug-in estimators of diversity indices on countable alphabets
- Reliability of information-based integration of EEG and fMRI data: a simulation study
- Analytical Calculation of Mutual Information between Weakly Coupled Poisson-Spiking Neurons in Models of Dynamically Gated Communication
- Nonparametric estimation of Kullback-Leibler divergence
- Sequential Fixed-Point ICA Based on Mutual Information Minimization
- Tight Data-Robust Bounds to Mutual Information Combining Shuffling and Model Selection Techniques
- Estimating Information Rates with Confidence Intervals in Neural Spike Trains
- Identification Entropy
- Edgeworth Approximation of Multivariate Differential Entropy
This page was built for publication: Estimation of Entropy and Mutual Information
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4816848)