Monte Carlo null models for genomic data

DOI10.1214/14-STS484zbMATH Open1332.62411arXiv1404.5970OpenAlexW2025893165MaRDI QIDQ254411FDOQ254411

Authors: Egil Ferkingstad, Lars Holden, Geir Kjetil Sandve 

Publication date: 8 March 2016

Published in: Statistical Science (Search for Journal in Brave)

Abstract: As increasingly complex hypothesis-testing scenarios are considered in many scientific fields, analytic derivation of null distributions is often out of reach. To the rescue comes Monte Carlo testing, which may appear deceptively simple: as long as you can sample test statistics under the null hypothesis, the $p$-value is just the proportion of sampled test statistics that exceed the observed test statistic. Sampling test statistics is often simple once you have a Monte Carlo null model for your data, and defining some form of randomization procedure is also, in many cases, relatively straightforward. However, there may be several possible choices of a randomization null model for the data and no clear-cut criteria for choosing among them. Obviously, different null models may lead to very different $p$-values, and a very low $p$-value may thus occur due to the inadequacy of the chosen null model. It is preferable to use assumptions about the underlying random data generation process to guide selection of a null model. In many cases, we may order the null models by increasing preservation of the data characteristics, and we argue in this paper that this ordering in most cases gives increasing $p$-values, that is, lower significance. We denote this as the null complexity principle. The principle gives a better understanding of the different null models and may guide in the choice between the different models.

Full work available at URL: https://arxiv.org/abs/1404.5970

Recommendations

• An extension of Monte Carlo hypothesis tests
• Generalized Monte Carlo significance tests
• A framework for Monte Carlo based multiple testing
• Finite-sample inference and nonstandard asymptotics with Monte Carlo tests and R
• A simple method for implementing Monte Carlo tests

zbMATH Keywords

hypothesis testingMonte Carlo methodsgenomics

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10) Hypothesis testing in multivariate analysis (62H15) Genetics and epigenetics (92D10)

Cites Work

• The second-order analysis of stationary point processes
• Title not available (Why is that?)
• Testing Statistical Hypotheses
• A Direct Approach to False Discovery Rates
• Large-Scale Simultaneous Hypothesis Testing
• A statistical significance testing approach to mining the most informative set of patterns
• Monte Carlo null models for genomic data
• Subsampling methods for genomic inference
• Estimating the Proportion of True Null Hypotheses, with application to DNA Microarray Data
• Randomization, bootstrap and Monte Carlo methods in biology

Cited In (2)

• Monte Carlo null models for genomic data
• ROhAN: row-order agnostic null models for statistically-sound knowledge discovery

Uses Software

• R
• MCFDR
• TRANSFAC
• CisModule

This page was built for publication: Monte Carlo null models for genomic data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q254411)