Kullback-Leibler divergence for Bayesian nonparametric model checking
From MaRDI portal
Publication:2131986
Abstract: Bayesian nonparametric statistics is an area of considerable research interest. While recently there has been an extensive concentration in developing Bayesian nonparametric procedures for model checking, the use of the Dirichlet process, in its simplest form, along with the Kullback-Leibler divergence is still an open problem. This is mainly attributed to the discreteness property of the Dirichlet process and that the Kullback-Leibler divergence between any discrete distribution and any continuous distribution is infinity. The approach proposed in this paper, which is based on incorporating the Dirichlet process, the Kullback-Leibler divergence and the relative belief ratio, is considered the first concrete solution to this issue. Applying the approach is simple and does not require obtaining a closed form of the relative belief ratio. A Monte Carlo study and real data examples show that the developed approach exhibits excellent performance.
Recommendations
- A nonparametric assessment of model adequacy based on Kullback-Leibler divergence
- Nonparametric estimation of Kullback-Leibler information illustrated by evaluating goodness of fit
- Characterizing variation of nonparametric random probability measures using the Kullback–Leibler divergence
- Nonparametric goodness-of-fit
- Bayesian nonparametric model selection and model testing
Cites work
- A Bayesian analysis of some nonparametric problems
- A Bayesian nonparametric estimation to entropy
- A Bayesian nonparametric goodness of fit test for right censored data based on approximate samples from the beta-Stacy process
- A Goodness-of-Fit Test for the Gumbel Distribution Based on Kullback–Leibler Information
- A Mathematical Theory of Communication
- A new estimator of entropy
- A new estimator of entropy
- A new estimator of entropy and its application in testing normality
- A new measure of entropy of continuous random variable
- A nonparametric assessment of model adequacy based on Kullback-Leibler divergence
- Bayesian and Conditional Frequentist Testing of a Parametric Model Versus Nonparametric Alternatives
- Bayesian goodness of fit testing with mixtures of triangular distributions
- Bayesian goodness-of-fit testing using infinite-dimensional exponential families
- Checking for prior-data conflict
- Data. A collection of problems from many fields for the student and research worker
- Distribution theory and inference for polynomial-normal densities
- Entropy estimators‐improvements and comparisons
- Entropy-based goodness-of-fit test for exponentiality
- Estimation of entropy using random sampling
- Exact and approximate sum representations for the Dirichlet process
- General treatment of goodness-of-fit tests based on Kullback-Leibler information
- Gibbs Sampling Methods for Stick-Breaking Priors
- Goodness of fit for the logistic regression model using relative belief
- Goodness-of-fit tests based on the distance between the Dirichlet process and its base measure
- scientific article; zbMATH DE number 3863589 (Why is no real title available?)
- scientific article; zbMATH DE number 65177 (Why is no real title available?)
- scientific article; zbMATH DE number 107482 (Why is no real title available?)
- scientific article; zbMATH DE number 3518103 (Why is no real title available?)
- scientific article; zbMATH DE number 1219014 (Why is no real title available?)
- scientific article; zbMATH DE number 3437452 (Why is no real title available?)
- scientific article; zbMATH DE number 774881 (Why is no real title available?)
- Hypothesis assessment and inequalities for Bayes factors and relative belief ratios
- Measuring statistical evidence using relative belief
- New entropy estimator with an application to test of normality
- Nonparametric estimation of Kullback-Leibler information illustrated by evaluating goodness of fit
- Nonparametric goodness-of-fit
- On a rapid simulation of the Dirichlet process
- On asymptotic properties and almost sure approximation of the normalized inverse-Gaussian process
- On functional central limit theorems of Bayesian nonparametric priors
- On simulation from infinitely divisible distributions
- On simulations from the two-parameter Poisson-Dirichlet process and the normalized inverse-Gaussian process
- Optimal robustness results for relative belief inferences and the relationship to prior-data conflict
- Prior-based model checking
- The two-sample problem via relative belief ratio
- Two measures of sample entropy
- Two-sample Bayesian nonparametric hypothesis testing
- Two-sample Kolmogorov-Smirnov test using a Bayesian nonparametric approach
Cited in
(9)- On robustness of the relative belief ratio and the strength of its evidence with respect to the geometric contamination prior
- Estimation of entropy and extropy based on right censored data: a Bayesian non-parametric approach
- Applications of a Kullback-Leibler divergence for comparing non-nested models
- Bayesian estimation of extropy and goodness of fit tests
- Nonparametric estimation of Kullback-Leibler information illustrated by evaluating goodness of fit
- A quantile approach to the Kullback-Leibler divergence on type-I censored variable and record values
- Advancements in Rényi entropy and divergence estimation for model assessment
- Evaluating model fit for type II censored data: a Bayesian non-parametric approach based on the Kullback-Leibler divergence estimation
- A nonparametric assessment of model adequacy based on Kullback-Leibler divergence
This page was built for publication: Kullback-Leibler divergence for Bayesian nonparametric model checking
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2131986)
