Generalizations of the familywise error rate
From MaRDI portal
Publication:2569237
Abstract: Consider the problem of simultaneously testing null hypotheses H_1,...,H_s. The usual approach to dealing with the multiplicity problem is to restrict attention to procedures that control the familywise error rate (FWER), the probability of even one false rejection. In many applications, particularly if s is large, one might be willing to tolerate more than one false rejection provided the number of such cases is controlled, thereby increasing the ability of the procedure to detect false null hypotheses. This suggests replacing control of the FWER by controlling the probability of k or more false rejections, which we call the k-FWER. We derive both single-step and stepdown procedures that control the k-FWER, without making any assumptions concerning the dependence structure of the p-values of the individual tests. In particular, we derive a stepdown procedure that is quite simple to apply, and prove that it cannot be improved without violation of control of the k-FWER. We also consider the false discovery proportion (FDP) defined by the number of false rejections divided by the total number of rejections (defined to be 0 if there are no rejections). The false discovery rate proposed by Benjamini and Hochberg [J. Roy. Statist. Soc. Ser. B 57 (1995) 289-300] controls E(FDP). Here, we construct methods such that, for any gamma and alpha, P{FDP>gamma}lealpha. Two stepdown methods are proposed. The first holds under mild conditions on the dependence structure of p-values, while the second is more conservative but holds without any dependence assumptions.
Recommendations
- Stepup procedures for control of generalizations of the familywise error rate
- Control of generalized error rates in multiple testing
- On stepdown control of the false discovery proportion
- Step-up and step-down procedures controlling the number and proportion of false positives
- Stepup procedures controlling generalized FWER and generalized FDR
Cites work
- A stochastic process approach to false discovery control.
- An improved Bonferroni procedure for multiple tests of significance
- Controlling the number of false discoveries: application to high-dimensional genomic data
- False Discovery Control for Random Fields
- scientific article; zbMATH DE number 3831073 (Why is no real title available?)
- scientific article; zbMATH DE number 50804 (Why is no real title available?)
- scientific article; zbMATH DE number 3624650 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 2220287 (Why is no real title available?)
- Multiple testing of pairs of one-sided hypotheses
- Some probability inequalities for ordered MTP₂ random variables: a proof of the Simes conjecture
- The control of the false discovery rate in multiple testing under dependency.
- The Simes Method for Multiple Hypothesis Testing With Positively Dependent Test Statistics
Cited in
(only showing first 100 items - show all)- Robustness of multiple testing procedures against dependence
- A new multiple testing method in the dependent case
- On a generalized false discovery rate
- Control of the false discovery rate under dependence using the bootstrap and subsampling
- Rejoinder on: Control of the false discovery rate under dependence using the bootstrap and subsampling
- Step-up and step-down procedures controlling the number and proportion of false positives
- Exceedance Control of the False Discovery Proportion
- Control of generalized error rates in multiple testing
- Statistical procedures for the market graph construction
- On correlated \(z\)-values distribution in hypothesis testing
- Comparing distributions by multiple testing across quantiles or CDF values
- The false discovery rate (FDR) of multiple tests in a class room lecture
- Sequential tests controlling generalized familywise error rates
- Measuring network systemic risk contributions: a leave-one-out approach
- Online rules for control of false discovery rate and false discovery exceedance
- Copulas, uncertainty, and false discovery rate control
- A new perspective on robust \(M\)-estimation: finite sample theory and applications to dependence-adjusted multiple testing
- Some optimality properties of FDR controlling rules under sparsity
- Two simple sufficient conditions for FDR control
- Asymptotic properties of false discovery rate controlling procedures under independence
- Multiple hypothesis testing on composite nulls using constrained \(p\)-values
- On stepwise control of the generalized familywise error rate
- Simultaneous high-probability bounds on the false discovery proportion in structured, regression and online settings
- Only closed testing procedures are admissible for controlling false discovery proportions
- FWER goes to zero for correlated normal
- Uncertainty quantification for robust variable selection and multiple testing
- Conditional calibration for false discovery rate control under dependence
- A comprehensive error rate for multiple testing
- Controlling the false discovery exceedance for heterogeneous tests
- New testing procedures with \(k\)-FWER control for discrete data
- A sufficient criterion for control of some generalized error rates in multiple testing
- High-dimensional mean estimation via \(\ell_1\) penalized normal likelihood
- Classes of multiple decision functions strongly controlling FWER and FDR
- New procedures controlling the false discovery proportion via Romano-Wolf's heuristic
- Explicit formulas for generalized family-wise error rates and unimprovable step-down multiple testing procedures
- Weighted multiple testing procedure for grouped hypotheses with \(k\)-FWER control
- Power-enhanced multiple decision functions controlling family-wise error and false discovery rates
- Exact calculations for false discovery proportion with application to least favorable configura\-tions
- Multiple testing via \(\mathrm{FDR}_L\) for large-scale imaging data
- Stepup procedures controlling generalized FWER and generalized FDR
- Generalizing Simes' test and Hochberg's stepup procedure
- Further results on controlling the false discovery proportion
- New multiple testing method under no dependency assumption, with application to multiple comparisons problem
- Simultaneous testing of multiple hypotheses using generalized \(p\)-values
- Familywise error rate control via knockoffs
- Bonferroni-type Plug-in Procedure Controlling Generalized Familywise Error Rate
- Variable selection using stepdown procedures in high-dimensional linear models
- Simultaneous confidence regions for closed tests, including Holm-, Hochberg-, and Hommel-related procedures
- Multiple Comparisons Controlling Expected Number of False Discoveries
- k-FWER control without \(p \)-value adjustment, with application to detection of genetic determinants of multiple sclerosis in Italian twins
- Simultaneous and selective inference: Current successes and future challenges
- Generalized Augmentation to Control the False Discovery Exceedance in Multiple Testing
- Procedures controlling the k-FDR using bivariate distributions of the null p-values
- A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion
- Parametric versus nonparametrics: two alternative methodologies
- FORMALIZED DATA SNOOPING BASED ON GENERALIZED ERROR RATES
- A note on control of the false discovery proportion
- Some implications of an alternative definition of the multiple comparison problem
- On improving some adaptive BH procedures controlling the FDR under dependence
- Step-up and step-down methods for testing multiple hypotheses in sequential experiments
- Control of the false discovery proportion for independently tested null hypotheses
- Step-up procedure controlling generalized family-wise error rate
- A sharp upper bound for the expected number of false rejections
- Multiple testing and error control in Gaussian graphical model selection
- Stepup procedures for control of generalizations of the familywise error rate
- Error rates for multivariate outlier detection
- Strong approximations of level exceedences related to multiple hypothesis testing
- A novel characterization of the generalized family wise error rate using empirical null distributions
- General theory of mixture procedures for gatekeeping
- Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces
- Controlling the false discovery rate with constraints: the Newman-Keuls test revisited
- On simultaneous calibration of two-sample t-tests for high-dimension low-sample-size data
- Efficient signal inclusion with genomic applications
- Farmtest: factor-adjusted robust multiple testing with approximate false discovery control
- Type I error rate control for testing many hypotheses: a survey with proofs
- Family-wise error rate of a step-down procedure
- On stepdown control of the false discovery proportion
- Some Results on the Control of the False Discovery Rate under Dependence
- A Conservative Test for Multiple Comparison Based on Highly Correlated Test Statistics
- A Note on Controlling the Number of False Positives
- Flexible Regression Model Selection for Survival Probabilities: With Application to AIDS
- Permutation-based simultaneous confidence bounds for the false discovery proportion
- Note on a stepwise procedure for rejecting at least k out of m hypotheses: A simple Holm‐type formulation and proof
- A stable sequential multiple test for Koopman-Darmois family
- Stepdown Procedures Controlling a Generalized False Discovery Rate
- On the false discovery proportion convergence under Gaussian equi-correlation
- Simultaneous critical values for t-tests in very high dimensions
- Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
- Deriving and comparing the distribution for the number of false positives in single step methods to control \(k\)-FWER
- A comment on: ``Invidious comparisons: ranking and selection as compound decisions by Jiaying Gu and Roger Koenker
- Behavior of FWER in Normal Distributions
- Bounds on generalized family-wise error rates for normal distributions
- Rejoinder to discussions on ``Optimal test procedures for multiple hypotheses controlling the familywise expected loss
- Competition-based control of the false discovery proportion
- Multiple testing approaches for hypotheses in integrative genomics
- An Empirical Bayes Approach to Controlling the False Discovery Exceedance
- Graphical approaches for the control of generalized error rates
- Asymptotically optimal sequential multiple testing with asynchronous decisions
- Multiple testing of a function's monotonicity
- Multiplicity in confirmatory clinical trials: a case study with discussion from a JSM panel
This page was built for publication: Generalizations of the familywise error rate
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2569237)
