Optimal and fast detection of spatial clusters with scan statistics
From MaRDI portal
Publication:2380095
DOI10.1214/09-AOS732zbMATH Open1183.62076arXiv1002.4770MaRDI QIDQ2380095FDOQ2380095
Authors: Guenther Walther 
Publication date: 24 March 2010
Published in: The Annals of Statistics (Search for Journal in Brave)
Abstract: We consider the detection of multivariate spatial clusters in the Bernoulli model with locations, where the design distribution has weakly dependent marginals. The locations are scanned with a rectangular window with sides parallel to the axes and with varying sizes and aspect ratios. Multivariate scan statistics pose a statistical problem due to the multiple testing over many scan windows, as well as a computational problem because statistics have to be evaluated on many windows. This paper introduces methodology that leads to both statistically optimal inference and computationally efficient algorithms. The main difference to the traditional calibration of scan statistics is the concept of grouping scan windows according to their sizes, and then applying different critical values to different groups. It is shown that this calibration of the scan statistic results in optimal inference for spatial clusters on both small scales and on large scales, as well as in the case where the cluster lives on one of the marginals. Methodology is introduced that allows for an efficient approximation of the set of all rectangles while still guaranteeing the statistical optimality results described above. It is shown that the resulting scan statistic has a computational complexity that is almost linear in .
Full work available at URL: https://arxiv.org/abs/1002.4770
Recommendations
fast algorithmconcentration inequalitymultiscale inferenceBernoulli modelscan statisticoptimal detection
Nonparametric hypothesis testing (62G10) Directional data; spatial statistics (62H11) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Hypothesis testing in multivariate analysis (62H15)
Cites Work
- Title not available (Why is that?)
- Multiscale testing of qualitative hypotheses
- Probability Inequalities for Sums of Bounded Random Variables
- Multiscale inference about a density
- Large-deviation approximations to the distribution of scan statistics
- A spatial scan statistic
- On the Distributions of Scan Statistics of a Two-Dimensional Poisson Process
- Scan statistics and applications
- Title not available (Why is that?)
- Scan statistics
- Two-dimensional discrete scan statistics
- Asymptotically exact nonparametric hypothesis testing in sup-norm and at a fixed point
- Clustering of Random Points in Two Dimensions
- Title not available (Why is that?)
Cited In (45)
- BET on independence
- Detecting clusters with increased mean using scan windows with variable radius
- Title not available (Why is that?)
- Spatial and temporal clustering based on the echelon scan technique and software analysis
- Distribution-free detection of structured anomalies: permutation and rank-based scans
- Detecting Markov random fields hidden in white noise
- Discovery of anomalous spatio‐temporal windows using discretized spatio‐temporal scan statistics
- Title not available (Why is that?)
- An Alternative Cluster Detection Test in Spatial Scan Statistics
- Instrument Validity Tests With Causal Forests
- Anomaly Detection for a Large Number of Streams: A Permutation-Based Higher Criticism Approach
- Variational multiscale nonparametric regression: smooth functions
- Multiscale change-point segmentation: beyond step functions
- Detection of an anomalous cluster in a network
- Wald-based spatial scan statistics for cluster detection
- Multiscale scanning in inverse problems
- Multiscale blind source separation
- Clustering with exclusion zones: genomic applications
- Spatial scan statistics for detection of multiple clusters with arbitrary shapes
- Localizing differentially evolving covariance structures via scan statistics
- Fisher Exact Scanning for Dependency
- Exact asymptotics for the scan statistic and fast alternatives
- Large-scale inference with block structure
- Change-point model on nonhomogeneous Poisson processes with application in copy number profiling by next-generation DNA sequencing
- Optimal detection of a jump in the intensity of a Poisson process or in a density with likelihood ratio statistics
- Cluster detection in networks using percolation
- Spatial multiresolution cluster detection method
- Structured correlation detection with application to colocalization analysis in dual-channel fluorescence microscopic imaging
- Hotspot detection with bivariate data
- Optimal calibration for multiple testing against local inhomogeneity in higher dimension
- Interpretable clustering using unsupervised binary trees
- Detecting a path of correlations in a network
- Multiscale Change Point Inference
- FDR-control in multiscale change-point segmentation
- TEAM: a multiple testing algorithm on the aggregation tree for flow cytometry analysis
- Optimal inference with a multidimensional multiscale statistic
- Asymptotic properties of spatial scan statistics under the alternative hypothesis
- Identifying the support of rectangular signals in Gaussian noise
- Multidimensional multiscale scanning in exponential families: limit theory and statistical consequences
- A multivariate Bayesian scan statistic for early event detection and characterization
- Anomaly detection: a functional analysis perspective
- Tail bounds for empirically standardized sums
- Optimal detection of multi-sample aligned sparse signals
- Analysis of Distributional Variation Through Graphical Multi-Scale Beta-Binomial Models
- Detecting structured signals in Ising models
This page was built for publication: Optimal and fast detection of spatial clusters with scan statistics
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2380095)
