Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses

DOI10.1214/009053605000000741zbMath1091.62059arXivmath/0501289OpenAlexW2144766920MaRDI QIDQ142489

John Rice, Nicolai Meinshausen, Nicolai Meinshausen, John A. Rice

Publication date: 1 February 2006

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/math/0501289

zbMATH Keywords

hypothesis testingmultiple comparisonssparsity

Mathematics Subject Classification ID

Parametric hypothesis testing (62F03) Hypothesis testing in multivariate analysis (62H15) Applications of statistics to physics (62P35) Paired and multiple comparisons; multiple testing (62J15) Statistical astronomy (85A35)

Related Items (76)

On the usage of randomized p-values in the Schweder-Spjøtvoll estimator ⋮ Controlling mixed directional false discovery rate in multidimensional decisions with applications to microarray studies ⋮ Detecting weak signals in high dimensions ⋮ Null-free false discovery rate control using decoy permutations ⋮ Box-constrained monotone approximations to Lipschitz regularizations, with applications to robust testing ⋮ Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing ⋮ FarmTest: Factor-Adjusted Robust Multiple Testing With Approximate False Discovery Control ⋮ Efficient Signal Inclusion With Genomic Applications ⋮ A parametric model to estimate the proportion from true null using a distribution for \(p\)-values ⋮ A powerful FDR control procedure for multiple hypotheses ⋮ On Efficient Estimators of the Proportion of True Null Hypotheses in a Multiple Testing Setup ⋮ Straight to the Source: Detecting Aggregate Objects in Astronomical Images With Proper Error Control ⋮ Mixed directional false discovery rate control in multiple pairwise comparisons using weightedp-values ⋮ On approximate validation of models: a Kolmogorov-Smirnov-based approach ⋮ The sparse Poisson means model ⋮ Adaptive testing on a regression function at a point ⋮ Constructing confidence intervals for selected parameters ⋮ Estimating the number of true null hypotheses in multiple hypothesis testing ⋮ A nonparametric mixture approach to density and null proportion estimation in large‐scale multiple comparison problems ⋮ Two-Component Mixture Model in the Presence of Covariates ⋮ Dynamic adaptive multiple tests with finite sample FDR control ⋮ Estimating the proportion of signal variables under arbitrary covariance dependence ⋮ Fast calculation of p-values for one-sided Kolmogorov-Smirnov type statistics ⋮ Estimating the amount of sparsity in two-point mixture models ⋮ Maximum likelihood estimation of the log-concave component in a semi-parametric mixture with a standard normal density ⋮ A guided random walk through some high dimensional problems ⋮ Control of the false discovery proportion for independently tested null hypotheses ⋮ Robust test for detecting a signal in a high dimensional sparse normal vector ⋮ Simultaneous critical values for \(t\)-tests in very high dimensions ⋮ Some optimality properties of FDR controlling rules under sparsity ⋮ Asymptotic Bayes-optimality under sparsity of some multiple testing procedures ⋮ GAP: A General Framework for Information Pooling in Two-Sample Sparse Inference ⋮ False discovery rate control with multivariate \(p\)-values ⋮ Asymptotic optimality of the Westfall-Young permutation procedure for multiple testing under dependence ⋮ A conservative estimator for the proportion of false nulls based on Dvoretzky, Kiefer and Wolfowitz inequality ⋮ Adaptive sensing performance lower bounds for sparse signal detection and support estimation ⋮ α-Investing: a Procedure for Sequential Control of Expected False Discoveries ⋮ An inequality for correlations in unidimensional monotone latent variable models for binary variables ⋮ An Efficient Morris Method-Based Framework for Simulation Factor Screening ⋮ Weighted \(p\)-value procedures for controlling FDR of grouped hypotheses ⋮ On the performance of FDR control: constraints and a partial solution ⋮ Adaptive estimation of the sparsity in the Gaussian vector model ⋮ Controlling the Familywise Error Rate with Plug-in Estimator for the Proportion of True Null Hypotheses ⋮ Generalized Augmentation to Control the False Discovery Exceedance in Multiple Testing ⋮ Goodness-of-fit tests via phi-divergences ⋮ Online rules for control of false discovery rate and false discovery exceedance ⋮ Stepup procedures controlling generalized FWER and generalized FDR ⋮ Estimation and confidence sets for sparse normal mixtures ⋮ Simultaneous high-probability bounds on the false discovery proportion in structured, regression and online settings ⋮ On false discovery control under dependence ⋮ Properties of higher criticism under strong dependence ⋮ Multiple Testing of Composite Null Hypotheses in Heteroscedastic Models ⋮ High frequency asymptotics for wavelet-based tests for Gaussianity and isotropy on the torus ⋮ Hypothesis testing, power and sample size determination for between group comparisons in fMRI experiments ⋮ An empirical Bayes mixture method for effect size and false discovery rate estimation ⋮ Innovated higher criticism for detecting sparse signals in correlated noise ⋮ A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion ⋮ Random thresholds for linear model selection ⋮ Uniformly consistently estimating the proportion of false null hypotheses via Lebesgue-Stieltjes integral equations ⋮ Bonferroni-type Plug-in Procedure Controlling Generalized Familywise Error Rate ⋮ Variable selection via adaptive false negative control in linear regression ⋮ Discussion of ``Multiple testing for exploratory research by J. J. Goeman and A. Solari ⋮ Only closed testing procedures are admissible for controlling false discovery proportions ⋮ Model selection with mixed variables on the Lasso path ⋮ Empirical Bayes analysis of RNA sequencing experiments with auxiliary information ⋮ HCTR ⋮ A new perspective on robust \(M\)-estimation: finite sample theory and applications to dependence-adjusted multiple testing ⋮ Exploring the Information in p‐Values for the Analysis and Planning of Multiple‐Test Experiments ⋮ Goodness-of-Fit Tests Based on Sup-Functionals of Weighted Empirical Processes ⋮ Theoretical Measures of Relative Performance of Classifiers for High Dimensional Data with Small Sample Sizes ⋮ Proportion of Non-Zero Normal Means: Universal Oracle Equivalences and Uniformly Consistent Estimators ⋮ On a generalized false discovery rate ⋮ On the false discovery rate and an asymptotically optimal rejection curve ⋮ A note on multiple testing for composite null hypotheses ⋮ Higher criticism: \(p\)-values and criticism ⋮ Higher criticism for large-scale inference, especially for rare and weak effects

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Higher criticism for detecting sparse heterogeneous mixtures.
• A stochastic process approach to false discovery control.
• Statistical methods for detecting stellar occultations by Kuiper Belt objects: the Taiwanese--American occultation survey
• Lower bounds for the number of false null hypotheses for multiple testing of associations under general dependence structures
• A Direct Approach to False Discovery Rates
• The statistical theory of the strength of bundles of threads. I

This page was built for publication: Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses