Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data

DOI10.1214/009053606000000920MaRDI QIDQ2373587zbMATH OpenOpenAlexWikidataFDO

Authors David Donoho, Jiashun Jin

Publication date 12 July 2007

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/math/0602311

zbMATH Keywords

multiple comparisonssparsitythreshold rulesminimum Bayes estimationmixtures of exponential models

Mathematics Subject Classification ID

Asymptotic properties of nonparametric inference (62G20) Estimation in multivariate analysis (62H12) Bayesian problems; characterization of Bayes procedures (62C10) Empirical decision procedures; empirical Bayes procedures (62C12) Minimax procedures in statistical decision theory (62C20) Paired and multiple comparisons; multiple testing (62J15)

Abstract: We apply FDR thresholding to a non-Gaussian vector whose coordinates X_i, i=1,..., n, are independent exponential with individual means $m{u}_i$. The vector $mu=(m{u}_i)$ is thought to be sparse, with most coordinates 1 but a small fraction significantly larger than 1; roughly, most coordinates are simply `noise,' but a small fraction contain `signal.' We measure risk by per-coordinate mean-squared error in recovering $log(m{u}_i)$, and study minimax estimation over parameter spaces defined by constraints on the per-coordinate p-norm of $log(m{u}_i)$: $frac1nsu{m}_{i=1}^{n}lo{g}^p(m{u}_i)leqet{a}^p$. We show for large n and small $eta$ that FDR thresholding can be nearly Minimax. The FDR control parameter 0<q<1 plays an important role: when $qleq1/2$, the FDR estimator is nearly minimax, while choosing a fixed q>1/2 prevents near minimaxity. These conclusions mirror those found in the Gaussian case in Abramovich et al. [Ann. Statist. 34 (2006) 584--653]. The techniques developed here seem applicable to a wide range of other distributional assumptions, other loss measures and non-i.i.d. dependency structures.

Recommendations

• Adapting to unknown sparsity by controlling the false discovery rate
• On false discovery rate thresholding for classification under sparsity
• Some optimality properties of FDR controlling rules under sparsity
• Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
• Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach

Cites work

• scientific article; zbMATH DE number 5604036 (Why is no real title available?)
• scientific article; zbMATH DE number 3984308 (Why is no real title available?)
• scientific article; zbMATH DE number 720689 (Why is no real title available?)
• scientific article; zbMATH DE number 3804673 (Why is no real title available?)
• scientific article; zbMATH DE number 802850 (Why is no real title available?)
• Adapting to unknown sparsity by controlling the false discovery rate
• An improved Bonferroni procedure for multiple tests of significance
• Asymptotic Minimax Character of the Sample Distribution Function and of the Classical Multinomial Estimator
• Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data
• Minimax estimation via wavelet shrinkage
• Minimax risk over \(l_ p\)-balls for \(l_ q\)-error
• Operating Characteristics and Extensions of the False Discovery Rate Procedure
• The Power of Rank Tests
• The tight constant in the Dvoretzky-Kiefer-Wolfowitz inequality

Cited in

(16)

• Rate of convergence of a risk estimator to the normal law in a multiple hypothesis testing problem using the FDR threshold
• Proportion of Non-Zero Normal Means: Universal Oracle Equivalences and Uniformly Consistent Estimators
• On false discovery rate thresholding for classification under sparsity
• Some optimality properties of FDR controlling rules under sparsity
• Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
• On the false discovery rate and an asymptotically optimal rejection curve
• Innovated higher criticism for detecting sparse signals in correlated noise
• Properties of higher criticism under strong dependence
• Asymptotically optimal sequential FDR and pFDR control with (or without) prior information on the number of signals
• Feature selection by higher criticism thresholding achieves the optimal phase diagram
• Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data
• Adapting to unknown sparsity by controlling the false discovery rate
• Modified versions of the Bayesian information criterion for sparse generalized linear models
• Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing
• Discovering the False Discovery Rate
• False discovery rate control with unknown null distribution: is it possible to mimic the oracle?

This page was built for publication: Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2373587)