Publication:6114035

DOI10.1016/J.IJAR.2023.02.007arXiv2210.13863MaRDI QIDQ6114035FDOQ6114035

Krasymyr Tretiak, Scott A. Ferson

Publication date: 11 July 2023

Published in: International Journal of Approximate Reasoning (Search for Journal in Brave)

Abstract: Data quality is an important consideration in many engineering applications and projects. Data collection procedures do not always involve careful utilization of the most precise instruments and strictest protocols. As a consequence, data are invariably affected by imprecision and sometimes sharply varying levels of quality of the data. Different mathematical representations of imprecision have been suggested, including a classical approach to censored data which is considered optimal when the proposed error model is correct, and a weaker approach called interval statistics based on partial identification that makes fewer assumptions. Maximizing the quality of statistical results is often crucial to the success of many engineering projects, and a natural question that arises is whether data of differing qualities should be pooled together or we should include only precise measurements and disregard imprecise data. Some worry that combining precise and imprecise measurements can depreciate the overall quality of the pooled data. Some fear that excluding data of lesser precision can increase their overall uncertainty about results because lower sample size implies more sampling uncertainty. This paper explores these concerns and describes simulation results that show when it is advisable to combine fairly precise data with rather imprecise data by comparing analyses using different mathematical representations of imprecision. Pooling data sets is preferred when the low-quality data set does not exceed a certain level of uncertainty. However, so long as the data are random, it may be legitimate to reject the low-quality data if its reduction of sampling uncertainty does not counterbalance the effect of its imprecision on the overall uncertainty.

Full work available at URL: https://arxiv.org/abs/2210.13863

zbMATH Keywords

censoringmaximum likelihoodimprecise dataepistemic uncertaintydescriptive statisticsKolmogorov-Smirnov

Mathematics Subject Classification ID

Reasoning under uncertainty in the context of artificial intelligence (68T37)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Nonparametric Estimation from Incomplete Observations
• Inference and missing data
• Symbolic Data Analysis
• The statistical analysis of interval-censored failure time data.
• Partial identification of probability distributions.
• Nonparametric Estimation of a Survivorship Function with Doubly Censored Data
• Confidence Intervals for Partially Identified Parameters
• Ignorability and coarse data
• Nonparametric bounds and sensitivity analysis of treatment effects
• Introduction to Interval Analysis
• Introduction to Imprecise Probabilities
• A characterization of limiting distributions of regular estimates
• Computational complexity and feasibility of data processing and interval computations
• Tutorial on maximum likelihood estimation
• On the Assumptions Used to Prove Asymptotic Normality of Maximum Likelihood Estimates
• Computing statistics under interval and fuzzy uncertainty. Applications to computer science and engineering
• Outlier detection under interval uncertainty: algorithmic solvability and computational complexity
• Table of Percentage Points of Kolmogorov Statistics

Cited In (1)

• Towards an automatic uncertainty compiler

This page was built for publication: Should data ever be thrown away? Pooling interval-censored data sets with different precision

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6114035)