Testing prediction algorithms as null hypotheses: application to assessing the performance of deep neural networks

DOI10.1002/STA4.270MaRDI QIDQ6541555zbMATH OpenFDO

Authors David R. Bickel

Publication date 19 May 2024

Published in Stat (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1002/STA4.270

zbMATH Keywords

big datadata sciencedeep learningdeep neural networkmodel predictive distributionmodel predictive valueregression

Mathematics Subject Classification ID

Statistics (62-XX)

Cites work

• A moment-based method for estimating the proportion of true null hypotheses and its application to microarray gene expression data
• A note on fiducial model averaging as an alternative to checking Bayesian and frequentist models
• A statistical method for estimating the proportion of differentially expressed genes
• An introduction to Bayesian analysis. Theory and methods.
• Bagging predictors
• Bayes and empirical Bayes methods for data analysis.
• Combining information from independent sources through confidence distributions
• Confidence, Likelihood, Probability
• Correcting false discovery rates for their bias toward false positives
• Estimating the Null and the Proportion of Nonnull Effects in Large-Scale Multiple Comparisons
• Estimating the Proportion of True Null Hypotheses, with application to DNA Microarray Data
• Forecast Combination and Model Averaging Using Predictive Measures
• scientific article; zbMATH DE number 3962977 (Why is no real title available?)
• scientific article; zbMATH DE number 3753890 (Why is no real title available?)
• scientific article; zbMATH DE number 3558709 (Why is no real title available?)
• Nonparametric bootstrap prediction
• On estimating the proportion of true null hypotheses for false discovery rate controlling procedures in exploratory DNA microarray studies
• Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing
• Post-Processing Posterior PredictivepValues
• Prediction with confidence -- a general framework for predictive inference
• Predictive fit for natural exponential families
• Statistical modeling: The two cultures. (With comments and a rejoinder).

Cited in

(2)

• VtNet: a neural network with variable importance assessment
• Bayesian Model Checking by Betting: A Game-Theoretic Alternative to Bayesian p -values and Classical Bayes Factors

This page was built for publication: Testing prediction algorithms as null hypotheses: application to assessing the performance of deep neural networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6541555)