Estimation of the false discovery proportion with unknown dependence

DOI10.1111/RSSB.12204zbMATH Open1373.62272arXiv1305.7007OpenAlexW1511750995WikidataQ47423341 ScholiaQ47423341MaRDI QIDQ5364902FDOQ5364902

Authors: X. Han, Jianqing Fan 

Publication date: 29 September 2017

Published in: Journal of the Royal Statistical Society Series B: Statistical Methodology (Search for Journal in Brave)

Abstract: Large-scale multiple testing with highly correlated test statistics arises frequently in many scientific research. Incorporating correlation information in estimating false discovery proportion has attracted increasing attention in recent years. When the covariance matrix of test statistics is known, Fan, Han & Gu (2012) provided a consistent estimate of False Discovery Proportion (FDP) under arbitrary dependence structure. However, the covariance matrix is often unknown in many applications and such dependence information has to be estimated before estimating FDP (Efron, 2010). The estimation accuracy can greatly affect the convergence result of FDP or even violate its consistency. In the current paper, we provide methodological modification and theoretical investigations for estimation of FDP with unknown covariance. First we develop requirements for estimates of eigenvalues and eigenvectors such that we can obtain a consistent estimate of FDP. Secondly we give conditions on the dependence structures such that the estimate of FDP is consistent. Such dependence structures include sparse covariance matrices, which have been popularly considered in the contemporary random matrix theory. When data are sampled from an approximate factor model, which encompasses most practical situations, we provide a consistent estimate of FDP via exploiting this specific dependence structure. The results are further demonstrated by simulation studies and some real data applications.

Full work available at URL: https://arxiv.org/abs/1305.7007

Recommendations

• Estimating false discovery proportion under arbitrary covariance dependence
• Estimating false discovery proportion in multiple comparison under dependency
• The effect of correlation in false discovery rate estimation
• A factor model approach to multiple testing under dependence
• Estimating the false discovery rate using the stochastic approximation algorithm

zbMATH Keywords

false discovery proportionlarge-scale multiple testingapproximate factor modelunknown covariance matrixdependent test statistics

Mathematics Subject Classification ID

Estimation in multivariate analysis (62H12) Hypothesis testing in multivariate analysis (62H15) Measures of association (correlation, canonical correlation, etc.) (62H20) Paired and multiple comparisons; multiple testing (62J15)

Cited In (30)

• Estimating false discovery proportion under arbitrary covariance dependence
• Estimating the false discovery rate using the stochastic approximation algorithm
• Predicting False Discovery Proportion Under Dependence
• Estimating minimum effect with outlier selection
• Empirical Bayes analysis of RNA sequencing experiments with auxiliary information
• False discovery rate control with unknown null distribution: is it possible to mimic the oracle?
• High-dimensional two-sample mean vectors test and support recovery with factor adjustment
• Conditional calibration for false discovery rate control under dependence
• Cauchy Combination Test: A Powerful Test With Analytic p-Value Calculation Under Arbitrary Dependency Structures
• Skilled Mutual Fund Selection: False Discovery Control Under Dependence
• A new perspective on robust \(M\)-estimation: finite sample theory and applications to dependence-adjusted multiple testing
• False discovery variance reduction in large scale simultaneous hypothesis tests
• The effect of correlation in false discovery rate estimation
• A dynamic screening algorithm for hierarchical binary marketing data
• Robust high-dimensional factor models with applications to statistical machine learning
• Overview of research advance for knockoff methods
• Quantile Correlation-based Variable Selection
• Multiple multi-sample testing under arbitrary covariance dependency
• A Factor-Adjusted Multiple Testing Procedure With Application to Mutual Fund Selection
• On the false discovery proportion convergence under Gaussian equi-correlation
• Factor-adjusted multiple testing of correlations
• Estimating and Accounting for Unobserved Covariates in High-Dimensional Correlated Data
• Estimating false discovery proportion in multiple comparison under dependency
• A Decorrelating and Debiasing Approach to Simultaneous Inference for High-Dimensional Confounded Models
• False Discovery Rate Control Under General Dependence By Symmetrized Data Aggregation
• Some permutation symmetric multiple hypotheses testing rules under dependent setup
• Estimation of false discovery proportion in multiple testing: from normal to chi-squared test statistics
• Multiple two-sample testing under arbitrary covariance dependency with an application in imaging mass spectrometry
• Testing of high dimensional mean vectors via approximate factor model
• Farmtest: factor-adjusted robust multiple testing with approximate false discovery control

This page was built for publication: Estimation of the false discovery proportion with unknown dependence

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5364902)