A Pessimistic Approximation for the Fisher Information Measure

DOI10.1109/TSP.2016.2617824MaRDI QIDQ4620544zbMATH OpenFDO

Authors Manuel S. Stein, J. A. Nossek

Publication date 8 February 2019

Published in IEEE Transactions on Signal Processing (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1508.03878

Mathematics Subject Classification ID

Measures of information, entropy (94A17)

Abstract: The problem of determining the intrinsic quality of a signal processing system with respect to the inference of an unknown deterministic parameter $heta$ is considered. While the Fisher information measure $F(heta)$ forms a classical tool for such a problem, direct computation of the information measure can become difficult in various situations. For the estimation theoretic performance analysis of nonlinear measurement systems, the form of the likelihood function can make the calculation of the information measure $F(heta)$ challenging. In situations where no closed-form expression of the statistical system model is available, the analytical derivation of $F(heta)$ is not possible at all. Based on the Cauchy-Schwarz inequality, we derive an alternative information measure $S(heta)$. It provides a lower bound on the Fisher information $F(heta)$ and has the property of being evaluated with the mean, the variance, the skewness and the kurtosis of the system model at hand. These entities usually exhibit good mathematical tractability or can be determined at low-complexity by real-world measurements in a calibrated setup. With various examples, we show that $S(heta)$ provides a good conservative approximation for $F(heta)$ and outline different estimation theoretic problems where the presented information bound turns out to be useful.

Cited in

(6)

• Information loss in a non-linear neuronal model
• scientific article; zbMATH DE number 5177494 (Why is no real title available?)
• On Fisher information inequalities in the presence of nuisance parameters
• scientific article; zbMATH DE number 4003310 (Why is no real title available?)
• scientific article; zbMATH DE number 978064 (Why is no real title available?)
• On the performance of Fisher information measure and Shannon entropy estimators

This page was built for publication: A Pessimistic Approximation for the Fisher Information Measure

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4620544)