Elements of Information Theory

DOI10.1002/047174882XMaRDI QIDQ5490912zbMATH OpenFDO

Publication date 4 October 2006

Statistical aspects of information-theoretic topics (62B10) Information theory (general) (94A15) Measures of information, entropy (94A17) Introductory exposition (textbooks, tutorial papers, etc.) pertaining to information and communication theory (94-01) Rate-distortion theory in information and communication theory (94A34)

Recommendations

Information theory. Coding theorems for discrete memoryless systems
An introduction to single-user information theory
scientific article; zbMATH DE number 1907194
Information theory and coding by example
The Theory of Information and Coding

Cited in

(only showing first 100 items - show all)

Assignment flows
A meaning based information theory - informalogical space: basic concepts and convergence of information sequences
Asymptotic optimality of myopic information-based strategies for Bayesian adaptive estimation
On the tightness of linear policies for stabilization of linear systems over Gaussian networks
Canonical failure modes of real-time control systems: insights from cognitive theory
ICA in Boolean XOR Mixtures
WAVELET LOSSY COMPRESSION OF RANDOM DATA
Direct density-ratio estimation with dimensionality reduction via least-squares hetero-distributional subspace search
Simple strategies for semi-supervised feature selection
Some informational inequalities involving generalized trigonometric functions and a new class of generalized moments
Action of the Euclidean versus projective group on an agent's internal space in curiosity driven exploration
Asymptotics of the mean-field Heisenberg model
A probabilistic PTAS for shortest common superstring
A path integral formalism for non-equilibrium Hamiltonian statistical systems
Bounds on sphere sizes in the sum-rank metric and coordinate-additive metrics
Shannon's Entropy and Its Generalisations Towards Statistical Inference in Last Seven Decades
Communication complexity with small advantage
Rényi entropy for multivariate controlled autoregressive moving average systems
The numeraire e-variable and reverse information projection
Toward Bayesian Data Compression
Generalized relative entropies and the capacity of classical-quantum channels
Variational Bayes and a problem of reliable communication. II: Infinite systems
Information geometric analysis of phase transitions in complex patterns: the case of the Gray-Scott reaction--diffusion model
What we learn from the learning rate
Metabolic free energy and biological codes: a `data rate theorem' aging model
Objective Bayesian analysis for the differential entropy of the Weibull distribution
The 7\% rule: a maximum entropy prediction on new decays of the Higgs boson
Learning optimal decision trees using constraint programming
Large-scale network motif analysis using compression
Exact equalities and thermodynamic relations for nonequilibrium steady states
Asymptotics of insensitive load balancing and blocking phases
Bayesian optimal design for non-linear model under non-regularity condition
A brief review of linear sufficient dimension reduction through optimization
Measuring inconsistency in probabilistic logic: rationality postulates and Dutch book interpretation
Random walks on directed covers of graphs
On quantifying dependence: a framework for developing interpretable measures
Entropic representation and estimation of diversity indices
On entropy, entropy-like quantities, and applications
Turing patterns with Turing machines: emergence and low-level structure formation
Detecting the sampling rate through observations
A random walk perspective on hide-and-seek games
Game-theoretic probability combination with applications to resolving conflicts between statistical methods
Copula index for detecting dependence and monotonicity between stochastic signals
A constrained BA algorithm for rate-distortion and distortion-rate functions
An information theoretic exploration of constrained MSSM
A calibrated fully interpretable fuzzy classifier via Vapnik-Chervonenkis-dimension minimization learning
In search of \(H\)-theorem for Ulam's redistribution of energy problem
Information-theoretic approximations of the nonnegative rank
On the Optimality of Linear Signaling to Deceive Kalman Filters over Finite/Infinite Horizons
Staircase patterns in words: subsequences, subwords, and separation number
Query lower bounds for log-concave sampling
scientific article; zbMATH DE number 53542 (Why is no real title available?)
Universal Features for High-Dimensional Learning and Inference
Two efficient selection methods for high‐dimensional <scp>CD‐CAT</scp> utilizing max‐marginals factor from <scp>MAP</scp> query and ensemble learning approach
Fano's inequality for random variables
Interpolation-based decoding of folded variants of linearized and skew Reed-Solomon codes
Sanov-type large deviations and conditional limit theorems for high-dimensional Orlicz balls
Correlation and collective behaviour in Adler-type locally coupled oscillators at the edge of chaos
Classical and Bayesian estimation of entropy for Pareto distribution in presence of outliers with application
Symmetry breaking and the emergence of path-dependence
Signalling and control of nonlinear partially observable stochastic systems: information states, sufficient statistics, and applications
Inferring evanescent stochastic dynamics from marginal distributions
Integrative exploration of large high-dimensional datasets
A resolution of St. Petersburg paradox
Asymptotic entropy of the ranges of random walks on discrete groups
Dependency reduction with divisive normalization: justification and effectiveness
A framework for group action-based multi-signatures and applications to LESS, MEDS, and ALTEQ
Geodesics and dynamical information projections on the manifold of Hölder equilibrium probabilities
TCMI: a non-parametric mutual-dependence estimator for multivariate continuous distributions
Information acquisition processes and their continuity: transforming uncertainty into risk
Optimal portfolio diversification via independent component analysis
Minimum and maximum information censoring plans in progressive censoring
Quantum Key Distribution Protocol Optimization
On Shannon entropy computations in selected plasticity problems
Binomial vs. Poisson statistics: from a toy model to a stochastic model for radioactive decay
Divergent predictive states: the statistical complexity dimension of stationary, ergodic hidden Markov processes
Dynamic discrete choice under rational inattention
On a lower bound for Fisher information by moment-generating function
Optimal estimation of high-dimensional sparse covariance matrices with missing data
On the maximum size of variable-length non-overlapping codes
A Boolean generalization of the information-gain model can eliminate specific reasoning errors
Adiabatic quantum estimation: a numerical study of the Heisenberg XX model with antisymmetric exchange
Segmentation uncertainty in multiple change-point models
Sequential Design with Mutual Information for Computer Experiments (MICE): Emulation of a Tsunami Model
The Wehrl entropy has Gaussian optimizers
Generative assignment flows for representing and learning joint distributions of discrete data
An adaptive heuristic for feature selection based on complementarity
Quantum de Moivre–Laplace theorem for noninteracting indistinguishable particles in random networks
Conditional entropy, entropy density, and strong law of large numbers for generalized controlled tree-indexed Markov chains
Enhancing crowding event detection on campus with multidimensional logs: a meta-heuristic search approach
Optimal information ratio of secret sharing schemes on Dutch windmill graphs
Partial monotonicity of entropy revisited
A k-provers parallel repetition theorem for a version of no-signaling model
A series of information measures of hesitant fuzzy soft sets and their application in decision making
Harmonic statistics
A Pseudo-Random Generator Whose Output is a Normal Sequence
Classical converse theorems in Lyapunov's second method
On the source-channel separation theorem for infinite source alphabets
A new class of weighted similarity indices using polytomous variables
A new measure between sets of probability distributions with applications to erratic financial behavior

This page was built for publication: Elements of Information Theory

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5490912)