Nonparametric statistical inference and imputation for incomplete categorical data

DOI10.4310/SII.2020.V13.N1.A2MaRDI QIDQ6096695zbMATH OpenOpenAlexWikidataFDO

Authors Chaojie Wang, Linghao Shen, Han Li, Xiaodan Fan

Publication date 15 September 2023

Published in Statistics and Its Interface (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1712.02214

zbMATH Keywords

imputationinfinite mixture modelmissing dataproduct-multinomial distribution

Mathematics Subject Classification ID

Statistics (62-XX)

Abstract: Missingness in categorical data is a common problem in various real applications. Traditional approaches either utilize only the complete observations or impute the missing data by some ad hoc methods rather than the true conditional distribution of the missing data, thus losing or distorting the rich information in the partial observations. In this paper, we propose the Dirichlet Process Mixture of Collapsed Product-Multinomials (DPMCPM) to model the full data jointly and compute the model efficiently. By fitting an infinite mixture of product-multinomial distributions, DPMCPM is applicable for any categorical data regardless of the true distribution, which may contain complex association among variables. Under the framework of latent class analysis, we show that DPMCPM can model general missing mechanisms by creating an extra category to denote missingness, which implicitly integrates out the missing part with regard to their true conditional distribution. Through simulation studies and a real application, we demonstrate that DPMCPM outperforms existing approaches on statistical inference and imputation for incomplete categorical data of various missing mechanisms. DPMCPM is implemented as the R package exttt{MMDai}, which is available from the Comprehensive R Archive Network at https://cran.r-project.org/web/packages/MMDai/index.html.

Cited in

(5)

• Working with missing data: imputation of nonresponse items in categorical survey data with a non-monotone missing pattern
• scientific article; zbMATH DE number 4205837 (Why is no real title available?)
• Imputing continuous data under some non‐Gaussian distributions
• Imputation procedures for categorical data: their effects on the goodness-of-fit chi-square statistic
• Dealing with zeros and missing values in compositional data sets using nonparametric imputation

This page was built for publication: Nonparametric statistical inference and imputation for incomplete categorical data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6096695)