False discovery variance reduction in large scale simultaneous hypothesis tests
From MaRDI portal
Abstract: Statistical dependence between hypotheses poses a significant challenge to the stability of large scale multiple hypotheses testing. Ignoring it often results in an unacceptably large spread in the false positive proportion even though the average value is acceptable [21, 39, 40, 49]. However, the statistical dependence structure of data is often unknown. Using a generic signalprocessing model, Bayesian multiple testing, and simulations, we demonstrate that the variance of the false positive proportion can be substantially reduced even under unknown short range dependence. We do this by modeling the data generating process as a stationary ergodic binary signal process embedded in noisy observations. We derive conditional probabilities needed for the Bayesian multiple testing by incorporating nearby observations into a second order Taylor series approximation. Simulations under general conditions are carried out to assess the validity and the variance reduction of the approach. Along the way, we address the problem of sampling a random Markov matrix with specified stationary distribution and lower bounds on the top absolute eigenvalues, which is of interest in its own right.
Recommendations
Cites work
- A general decision theoretic formulation of procedures controlling FDR and FNR from a Bayesian perspective
- A general framework for multiple testing dependence
- A Relationship Between Arbitrary Positive Matrices and Doubly Stochastic Matrices
- A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion
- A stochastic process approach to false discovery control.
- A study of convex sets of stochastic matrices induced by probability vectors
- An improved Bonferroni procedure for multiple tests of significance
- Circular law theorem for random Markov matrices
- Concerning Diagonal Similarity of Irreducible Matrices
- Control of the mean number of false discoveries, Bonferroni and stability of multiple testing
- Convergence Rates for Markov Chains
- Correlated z-values and the accuracy of large-scale statistical estimates
- Correlation and Large-Scale Simultaneous Significance Testing
- Diagonal Equivalence to Matrices with Prescribed Row and Column Sums
- Distribution of Subdominant Eigenvalues of Matrices with Random Rows
- Effects of statistical dependence on multiple testing under a hidden Markov model
- Empirical Bayes Analysis of a Microarray Experiment
- Estimating false discovery proportion under arbitrary covariance dependence
- Estimation of the false discovery proportion with unknown dependence
- Exact calculations for false discovery proportion with application to least favorable configura\-tions
- False discovery and false nondiscovery rates in single-step multiple testing procedures
- Gibbs/Metropolis algorithms on a convex polytope
- Hidden Markov random fields
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- Large-scale multiple testing under dependence
- Large-Scale Simultaneous Hypothesis Testing
- Line-sum-symmetric scalings of square nonnegative matrices
- Markov chains and mixing times. With a chapter on ``Coupling from the past by James G. Propp and David B. Wilson.
- Multiple testing of local maxima for detection of peaks in 1D
- Multiple testing of local maxima for detection of peaks in random fields
- Multiple testing under dependence via graphical models
- On false discovery control under dependence
- On the scaling of multidimensional matrices
- Power and stability comparisons of multiple testing procedures with false discovery rate control
- Random bistochastic matrices
- Robustness of multiple testing procedures against dependence
- Scaling of matrices to achieve specified row and column sums
- Scalings of matrices which have prespecified row sums and column sums via optimization
- Some results on false discovery rate in stepwise multiple testing procedures.
- Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
- The control of the false discovery rate in multiple testing under dependency.
- The cutoff phenomenon in finite Markov chains.
- The diagonal equivalence of a nonnegative matrix to a stochastic matrix
- The Dirichlet Markov ensemble
- The effect of correlation in false discovery rate estimation
- The Sinkhorn–Knopp Algorithm: Convergence and Applications
- Type I error rate control for testing many hypotheses: a survey with proofs
- Variance of the Number of False Discoveries
- What does a random contingency table look like?
Cited in
(3)
This page was built for publication: False discovery variance reduction in large scale simultaneous hypothesis tests
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2241618)
