Optimal sequential detection in multi-stream data
From MaRDI portal
Publication:134124
DOI10.1214/17-AOS1546zbMATH Open1388.62127arXiv1506.08504MaRDI QIDQ134124FDOQ134124
Authors: Hock Peng Chan, Hock Peng Chan 
Publication date: 1 December 2017
Published in: The Annals of Statistics (Search for Journal in Brave)
Abstract: Consider a large number of detectors each generating a data stream. The task is to detect online, distribution changes in a small fraction of the data streams. Previous approaches to this problem include the use of mixture likelihood ratios and sum of CUSUMs. We provide here extensions and modifications of these approaches that are optimal in detecting normal mean shifts. We show how the (optimal) detection delay depends on the fraction of data streams undergoing distribution changes as the number of detectors goes to infinity. There are three detection domains. In the first domain for moderately large fractions, immediate detection is possible. In the second domain for smaller fractions, the detection delay grows logarithmically with the number of detectors, with an asymptotic constant extending those in sparse normal mixture detection. In the third domain for even smaller fractions, the detection delay lies in the framework of the classical detection delay formula of Lorden. We show that the optimal detection delay is achieved by the sum of detectability score transformations of either the partial scores or CUSUM scores of the data streams.
Full work available at URL: https://arxiv.org/abs/1506.08504
Recommendations
- Asymptotically optimal quickest change detection in multistream data -- Part 1: General stochastic models
- Efficient scalable schemes for monitoring a large number of data streams
- Sequential multi-sensor change-point detection
- Optimal detection of changing properties of random sequences. II: Sequential detection
- Sequential detection/isolation of abrupt changes
Cited In (27)
- Sequential common change detection, isolation, and estimation in multiple poisson processes
- Title not available (Why is that?)
- Sequential detection of targets in multichannel systems
- Asymptotic optimality theory for active quickest detection with unknown postchange parameters
- Estimation of common change point and isolation of changed panels after sequential detection
- ocd
- Common change-point estimation and changed panel isolation after sequential detection in an exponential family
- A communication-efficient, online changepoint detection method for monitoring distributed sensor networks
- Bandit Change-Point Detection for Real-Time Monitoring High-Dimensional Data Under Sampling Control
- Sequential Common Change Detection and Isolation of Changed Panels in Panel Data
- Large-Scale Datastreams Surveillance via Pattern-Oriented-Sampling
- Compound Sequential Change-point Detection in Parallel Data Streams
- Breadth-first maximum likelihood sequence detection: Basics
- Quickest changepoint detection in general multistream stochastic models: recent results, applications and future challenges
- Adaptive Partially Observed Sequential Change Detection and Isolation
- A combined SR-CUSUM procedure for detecting common changes in panel data
- Isolating changed panels and estimating common change point after sequential detection with FDR control
- False discovery rate approach to dynamic change detection
- Asymptotically optimal quickest change detection in multistream data -- Part 1: General stochastic models
- Efficient scalable schemes for monitoring a large number of data streams
- Using labeled data to evaluate change detectors in a multivariate streaming environment
- Sequential Nonparametric Tests for a Change in Distribution: An Application to Detecting Radiological Anomalies
- Robust change detection for large-scale data streams
- Asymptotic statistical properties of communication-efficient quickest detection schemes in sensor networks
- Online multivariate changepoint detection with type I error control and constant time/memory updates per series
- Optimal on-line detection of outside observations
- Optimal unimodular sequences design method for active sensing systems
This page was built for publication: Optimal sequential detection in multi-stream data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q134124)
