Some further results on the minimum error entropy estimation
Summary: The minimum error entropy (MEE) criterion has been receiving increasing attention due to its promising perspectives for applications in signal processing and machine learning. In the context of Bayesian estimation, the MEE criterion is concerned with the estimation of a certain random variable based on another random variable, so that the error's entropy is minimized. Several theoretical results on this topic have been reported. In this work, we present some further results on the MEE estimation. The contributions are twofold: (1) we extend a recent result on the minimum entropy of a mixture of unimodal and symmetric distributions to a more general case, and prove that if the conditional distributions are generalized uniformly dominated (GUD), the dominant alignment will be the MEE estimator; (2) we show by examples that the MEE estimator (not limited to singular cases) may be non-unique even if the error distribution is restricted to zero-mean (unbiased).
- \(\Delta \)-entropy: definition, properties and applications in system identification with quantized data
- A new interpretation on the MMSE as a robust MEE criterion
- An application of the information theory to estimation problems
- An extended orthogonal forward regression algorithm for system identification using entropy
- Entropy analysis of estimating systems
- Information theoretic learning. Renyi's entropy and kernel perspectives
- Linear prediction, filtering, and smoothing: An information-theoretic approach
- Minimum entropy control of closed-loop tracking errors for dynamic stochastic systems
- Minimum entropy control of non-Gaussian dynamic stochastic systems
- Minimum entropy filtering for multivariate stochastic systems with non-Gaussian noises
- Minimum entropy of error principle in estimation
- Minimum-entropy estimation in semi-parametric models
- On optimal estimations with minimum error entropy criterion
- On the Minimum Entropy of a Mixture of Unimodal and Symmetric Distributions
- Optimal state estimation for stochastic systems: an information theoretic approach
- Robustness and risk-sensitive filtering
- Minimum entropy of error principle in estimation
- A new interpretation on the MMSE as a robust MEE criterion
- Fast rates of minimum error entropy with heavy-tailed noise
- A proportionate normalized maximum correntropy criterion algorithm with correntropy induced metric constraint for identifying sparse systems
- Mixture quantized error entropy for recursive least squares adaptive filtering
- Proportionate minimum error entropy algorithm for sparse system identification
- A note on the W-S lower bound of the MEE estimation
- An extended result on the optimal estimation under the minimum error entropy criterion
- Minimum mean-squared error estimation of stochastic processes by mutual entropy
- On the smoothed minimum error entropy criterion
- Entropy and Minimal Bit Rates for State Estimation and Model Detection
- Minimum entropy of error estimation for discrete random variables
- Learning theory of minimum error entropy under weak moment conditions
- scientific article; zbMATH DE number 958375 (Why is no real title available?)
- Improved Bounds on Fourier Entropy and Min-Entropy
- From -entropy to KL-entropy: analysis of minimum information complexity density estima\-tion
- On optimal estimations with minimum error entropy criterion
This page was built for publication: Some further results on the minimum error entropy estimation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q406075)
