Streaming generalized cross entropy

DOI10.1007/S00500-019-04632-WMaRDI QIDQ2156541zbMATH OpenOpenAlexWikidataFDO

Authors Mario Angelelli, Enrico Ciavolino, Paola Pasca

Publication date 18 July 2022

Published in Soft Computing (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1811.09710

zbMATH Keywords

adaptive processgeneralized cross entropygeneralized maximum entropystreaming data

Mathematics Subject Classification ID

Measures of information, entropy (94A17)

Abstract: We propose a new method to combine adaptive processes with a class of entropy estimators for the case of streams of data. Starting from a first estimation obtained from a batch of initial data, model parameters are estimated at each step by combining the prior knowledge with the new observation (or a block of observations). This allows to extend the maximum entropy technique to a dynamical setting, also distinguishing between entropic contributions of the signal and the error. Furthermore, it provides a suitable approximation of standard GME problems when the exacted solutions are hard to evaluate. We test this method by performing numerical simulations at various sample sizes and batch dimensions. Moreover, we extend this analysis exploring intermediate cases between streaming GCE and standard GCE, i.e. considering blocks of observations of different sizes to update the estimates, and incorporating collinearity effects as well. The role of time in the balance between entropic contributions of signal and errors is further explored considering a variation of the Streaming GCE algorithm, namely, Weighted Streaming GCE. Finally, we discuss the results: in particular, we highlight the main characteristics of this method, the range of application, and future perspectives.

Recommendations

• Estimating Entropy over Data Streams
• Estimation of Probability Density Function, Differential Entropy and Other Relative Quantities for Data Streams with Concept Drift
• Estimating Entropy and Entropy Norm on Data Streams
• Estimating Entropy and Entropy Norm on Data Streams
• Generalized maximum entropy estimation

Cites work

• A formal theory of inductive inference. Part I
• A weighted generalized maximum entropy estimator with a data-driven weight
• Combined Primal-Dual and Penalty Methods for Constrained Minimization
• Comparing generalised maximum entropy and partial least squares methods for structural equation models
• Elements of Information Theory
• Foundations of Info-Metrics
• Generalized cross entropy method for analysing the SERVQUAL model
• scientific article; zbMATH DE number 3143967 (Why is no real title available?)
• scientific article; zbMATH DE number 1241792 (Why is no real title available?)
• scientific article; zbMATH DE number 1082203 (Why is no real title available?)
• scientific article; zbMATH DE number 1753141 (Why is no real title available?)
• Modelling the quality of work in the Italian social co-operatives combining NPCA-RSM and SEM-GME approaches
• Probability Theory
• Recursive Update Filtering for Nonlinear Estimation
• Simultaneous Equation Model based on the generalized maximum entropy for studying the effect of management factors on enterprise performance
• Tropical limit and a micro-macro correspondence in statistical physics
• Zeros and amoebas of partition functions

This page was built for publication: Streaming generalized cross entropy

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2156541)