Goodness-of-fit tests via phi-divergences

DOI10.1214/0009053607000000244MaRDI QIDQ2466682zbMATH OpenOpenAlexFDO

Authors Leah Jager, Jon A. Wellner

Publication date 16 January 2008

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/math/0603238, https://projecteuclid.org/euclid.aos/1194461721

zbMATH Keywords

alternativescombining p-valuesconfidence bandsHellingerlarge deviationsmultiple comparisonsnormalized empirical processPoisson boundaries

Mathematics Subject Classification ID

Strong limit theorems (60F15) Asymptotic distribution theory in statistics (62E20) Nonparametric hypothesis testing (62G10) Nonparametric tolerance and confidence regions (62G15) Asymptotic properties of nonparametric inference (62G20)

Abstract: A unified family of goodness-of-fit tests based on $phi$-divergences is introduced and studied. The new family of test statistics $S_n(s)$ includes both the supremum version of the Anderson--Darling statistic and the test statistic of Berk and Jones [Z. Wahrsch. Verw. Gebiete 47 (1979) 47--59] as special cases ($s=2$ and $s=1$, resp.). We also introduce integral versions of the new statistics. We show that the asymptotic null distribution theory of Berk and Jones [Z. Wahrsch. Verw. Gebiete 47 (1979) 47--59] and Wellner and Koltchinskii [High Dimensional Probability III (2003) 321--332. Birkh"{a}user, Basel] for the Berk--Jones statistic applies to the whole family of statistics $S_n(s)$ with $sin[-1,2]$. On the side of power behavior, we study the test statistics under fixed alternatives and give extensions of the ``Poisson boundary phenomena noted by Berk and Jones for their statistic. We also extend the results of Donoho and Jin [Ann. Statist. 32 (2004) 962--994] by showing that all our new tests for $sin[-1,2]$ have the same ``optimal detection boundary for normal shift mixture alternatives as Tukey's ``higher-criticism statistic and the Berk--Jones statistic.

Recommendations

• Goodness-of-fit tests based on \(K_{\phi }\)-divergence.
• Tests of goodness of fit based on phi-divergence
• On properties of the \((\Phi , a)\)-power divergence family with applications in goodness of fit tests
• Divergence statistics: sampling properties and multinomial goodness of fit and divergence tests
• scientific article; zbMATH DE number 2129922

Cites work

• A Glivenko-Cantelli theorem and strong laws of large numbers for functions of order statistics
• A limit theorem for the maximum of normalized sums of independent random variables
• A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations
• Asymptotic Efficiency of Nonparametric Tests
• Asymptotic Theory of Certain "Goodness of Fit" Criteria Based on Stochastic Processes
• Calculation of noncrossing probabilities for Poisson processes and its corollaries.
• Detecting a target in very noisy data from mutliple looks
• Distributions related to linear bounds for the empirical distribution function
• Empirical likelihood based hypothesis testing
• Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
• Estimation and confidence sets for sparse normal mixtures
• Exact Bahadur Efficiencies for the Kolmogorov-Smirnov and Kuiper One- and Two-Sample Statistics
• Foundations of Modern Probability
• Global power functions of goodness of fit tests.
• Goodness of fit tests for “Chimeric” alternatives
• Goodness-of-fit test statistics that dominate the Kolmogorov statistics
• Goodness-of-fit tests via phi-divergences
• Higher criticism for detecting sparse heterogeneous mixtures.
• scientific article; zbMATH DE number 5604036 (Why is no real title available?)
• scientific article; zbMATH DE number 3905632 (Why is no real title available?)
• scientific article; zbMATH DE number 3911472 (Why is no real title available?)
• scientific article; zbMATH DE number 3962966 (Why is no real title available?)
• scientific article; zbMATH DE number 4072103 (Why is no real title available?)
• scientific article; zbMATH DE number 3524591 (Why is no real title available?)
• scientific article; zbMATH DE number 3626429 (Why is no real title available?)
• scientific article; zbMATH DE number 2078189 (Why is no real title available?)
• scientific article; zbMATH DE number 3252891 (Why is no real title available?)
• scientific article; zbMATH DE number 3322635 (Why is no real title available?)
• scientific article; zbMATH DE number 3200971 (Why is no real title available?)
• Large deviations of goodness of fit statistics and linear combinations of order statistics
• Limit theorems for the ratio of the empirical distribution function to the true distribution function
• Minimax detection of a signal for \(l^ n\)-balls.
• Nonparametric Likelihood Confidence Bands for a Distribution Function
• On some global measures of the deviations of density function estimates
• On the ``Poisson boundaries of the family of weighted Kolmogorov statistics
• Some problems of hypothesis testing leading to infinitely divisible distributions
• The asymptotic distribution of the suprema of the standardized empirical processes
• The asymptotic distribution of the supremum of the standardized empirical distribution function on subintervals
• The Calculation of Distributions of Two-Sided Kolmogorov-Smirnov Type Statistics
• Theory of statistical inference and information. Transl. from the Slovak by the author

Cited in

(79)

• Higher criticism for discriminating word-frequency tables and authorship attribution
• Asymptotic normality for the \(K_{\phi}\)-divergence goodness-of-fit tests
• Data-driven robust optimization
• Detectability of nonparametric signals: higher criticism versus likelihood ratio
• A conversation with Jon Wellner
• Some approximations to power functions of -divergence tests in parametric models
• Asymptotic approximations for the distributions of the K-divergence goodness-of-fit statistics
• Nonparametric tests for stochastic ordering
• Detection boundary in sparse regression
• Distance-based tests for planar shape
• The general goodness-of-fit tests for correlated data
• Higher criticism to compare two large frequency tables, with sensitivity to possible rare and weak differences
• Large-scale inference with block structure
• On the asymptotic distribution of the scan statistic for empirical distributions
• Directional differentiability for supremum-type functionals: statistical applications
• Beyond HC: more sensitive tests for rare/weak alternatives
• On properties of the \((\Phi , a)\)-power divergence family with applications in goodness of fit tests
• Signal detection via Phi-divergences for general mixtures
• Higher criticism: \(p\)-values and criticism
• Distribution-free tests for sparse heterogeneous mixtures
• Optimal detection of weak positive latent dependence between two sequences of multiple tests
• Empirical likelihood test via estimating equations
• Optimal classification in sparse Gaussian graphic model
• Goodness-of-fit tests via phi-divergences
• Properties of higher criticism under strong dependence
• Nonparametric maximum likelihood approach to multiple change-point problems
• Higher criticism for large-scale inference, especially for rare and weak effects
• A goodness-of-fit test for heavy tailed distributions with unknown parameters and its application to simulated precipitation extremes in the Euro-Mediterranean region
• Influential observation in complex normal data for problems in allometry
• Goodness of fit tests in terms of local levels with special emphasis on higher criticism tests
• Approximation of distributions by using the Anderson Darling statistic
• -divergences, sufficiency, Bayes sufficiency, and deficiency
• The intermediates take it all: asymptotics of higher criticism statistics and a powerful alternative based on equal local levels
• Asymptotics of goodness-of-fit tests based on minimum p-value statistics
• Reversed Berk-Jones tests under a composite null hypothesis
• Monte Carlo comparison of seven normality tests
• On the exact Berk-Jones statistics and their p-value calculation
• Optimal detection of heterogeneous and heteroscedastic mixtures
• A family of power-divergence diagnostics for goodness-of-fit
• Classification of sparse high-dimensional vectors
• Feature selection by higher criticism thresholding achieves the optimal phase diagram
• Jackknife empirical likelihood tests for distribution functions
• scientific article; zbMATH DE number 2078189 (Why is no real title available?)
• Goodness of fit tests for a class of Markov random field models
• A new test for two-sample location problem based on empirical distribution function
• Goodness-of-fit tests based on correcting moments of entropy estimators
• Goodness-of-fit tests based on sup-functionals of weighted empirical processes
• Intermediate efficiency of some weighted goodness-of-fit statistics
• Information criteria in classification: new divergence-based classifiers
• Diagonally Dominant Principal Component Analysis
• Power comparisons of the unbiased Berk-Jones test and the unbiased reversed Berk-Jones test
• A test statistic with a ranking method based on the Jeffreys divergence measure
• A Monte Carlo approach to quantifying discrepancies between intractable posterior distributions
• Fast calculation of boundary crossing probabilities for Poisson processes
• Genetic variant set-based tests using the generalized Berk-Jones statistic with application to a genome-wide association study of breast cancer
• Tests of goodness of fit based on phi-divergence
• An estimation of Phi divergence and its application in testing normality
• General treatment of goodness-of-fit tests based on Kullback-Leibler information
• Goodness-of-fit tests via ϕ-measures of divergence for censored data
• Testing exponentiality based on characterizations of the exponential distribution
• On the ``Poisson boundaries of the family of weighted Kolmogorov statistics
• Goodness-of-fit tests based on \(K_{\phi }\)-divergence.
• Intermediate efficiency in nonparametric testing problems with an application to some weighted statistics
• Non-asymptotic detection of two-component mixtures with unknown means
• A new approach to tests and confidence bands for distribution functions
• Detection boundary for a sparse gamma scale mixture model
• One‐two dependence and probability inequalities between one‐ and two‐sided union‐intersection tests
• On Goodness of Fit for Operational Risk
• Detecting sparse heterogeneous mixtures in a two-sample problem
• Fast calculation of p-values for one-sided Kolmogorov-Smirnov type statistics
• Consistency of the generalized likelihood ratio test for heteroscedastic normal mixtures
• Exact nonparametric confidence bands for the survivor function
• Assessing goodness-of-fit for sparse categories using Rényi divergence
• Tail similarity
• Robust detection of watermarks for large language models under human edits
• Optimal detection of multi-sample aligned sparse signals
• Innovated higher criticism for detecting sparse signals in correlated noise
• New goodness-of-fit tests based on fiducial empirical distribution function
• Generalized Cramér-von Mises goodness-of-fit tests for multivariate distributions

This page was built for publication: Goodness-of-fit tests via phi-divergences

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2466682)