Minimum entropy of error principle in estimation (Q1331031): Difference between revisions

The principle of minimum error entropy estimation as found in the work of \textit{H. L. Weidemann} and \textit{E. B. Stear} [Inf. Control 14, 493-506 (1969; Zbl 0212.233), and IEEE Trans. Inf. Theory IT-16, 264-270 (1970; Zbl 0205.209)] is reformulated as a problem of finding optimum locations of probability densities in a given mixture such that the resulting (differential) entropy is minimized. New results concerning the entropy lower bound are derived. Continuity of the entropy and attaining the minimum entropy are proved in the case where the mixture is finite. Some other examples and situations, in particular that of symmetric unimodal densities, are studied in more detail.