Identifying excessively rounded or truncated data

Abstract: All data are digitized, and hence are essentially integers rather than true real numbers. Ordinarily this causes no difficulties since the truncation or rounding usually occurs below the noise level. However, in some instances, when the instruments or data delivery and storage systems are designed with less than optimal regard for the data or the subsequent data analysis, the effects of digitization may be comparable to important features contained within the data. In these cases, information has been irrevocably lost in the truncation process. While there exist techniques for dealing with truncated data, we propose a straightforward method that will allow us to detect this problem before the data analysis stage. It is based on an optimal histogram binning algorithm that can identify when the statistical structure of the digitization is on the order of the statistical structure of the data set itself.

Recommendations

Cites work

Cited in

(1)

Fast and fully-automated histograms for large-scale data sets

Describes a project that uses

Uses Software

BayesDA

This page was built for publication: Identifying excessively rounded or truncated data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3298618)