Optimal sequential detection in multi-stream data
From MaRDI portal
Abstract: Consider a large number of detectors each generating a data stream. The task is to detect online, distribution changes in a small fraction of the data streams. Previous approaches to this problem include the use of mixture likelihood ratios and sum of CUSUMs. We provide here extensions and modifications of these approaches that are optimal in detecting normal mean shifts. We show how the (optimal) detection delay depends on the fraction of data streams undergoing distribution changes as the number of detectors goes to infinity. There are three detection domains. In the first domain for moderately large fractions, immediate detection is possible. In the second domain for smaller fractions, the detection delay grows logarithmically with the number of detectors, with an asymptotic constant extending those in sparse normal mixture detection. In the third domain for even smaller fractions, the detection delay lies in the framework of the classical detection delay formula of Lorden. We show that the optimal detection delay is achieved by the sum of detectability score transformations of either the partial scores or CUSUM scores of the data streams.
The author considers a large number of data streams, with the aim to detect, online, distributional changes in a small fraction of the streams as quickly as possible. It turns out that optimality depends on the fraction of the streams that undergo a change. It is, for example, shown that a modified version of the mixture likelihood ration approach achieves minimum detection delay under a constraint on the average run length.
Recommendations
- Asymptotically optimal quickest change detection in multistream data -- Part 1: General stochastic models
- Efficient scalable schemes for monitoring a large number of data streams
- Sequential multi-sensor change-point detection
- Optimal detection of changing properties of random sequences. II: Sequential detection
- Sequential detection/isolation of abrupt changes
Cited in
(36)- Optimal on-line detection of outside observations
- Efficient scalable schemes for monitoring a large number of data streams
- Sequential multi-sensor change-point detection
- ocd
- Optimal unimodular sequences design method for active sensing systems
- Using labeled data to evaluate change detectors in a multivariate streaming environment
- Online multivariate changepoint detection with type I error control and constant time/memory updates per series
- Asymptotically optimal quickest change detection in multistream data -- Part 1: General stochastic models
- Common change-point estimation and changed panel isolation after sequential detection in an exponential family
- Breadth-first maximum likelihood sequence detection: Basics
- Change detection based on the distribution of \(p\)-values
- Sequential Common Change Detection and Isolation of Changed Panels in Panel Data
- Scalable sum-shrinkage schemes for distributed monitoring large-scale data streams
- Asymptotic statistical properties of communication-efficient quickest detection schemes in sensor networks
- Sequential detection of targets in multichannel systems
- Single and multiple change-point detection with differential privacy
- Isolating changed panels and estimating common change point after sequential detection with FDR control
- A combined SR-CUSUM procedure for detecting common changes in panel data
- Robust change detection for large-scale data streams
- Sequential common change detection, isolation, and estimation in multiple Poisson processes
- Optimal Sequential Tests for Monitoring Changes in the Distribution of Finite Observation Sequences
- Estimation of common change point and isolation of changed panels after sequential detection
- Sequential nonparametric tests for a change in distribution: an application to detecting radiological anomalies
- Large-Scale Datastreams Surveillance via Pattern-Oriented-Sampling
- Compound Sequential Change-point Detection in Parallel Data Streams
- False discovery rate approach to dynamic change detection
- Asymptotic optimality theory for active quickest detection with unknown postchange parameters
- A communication-efficient, online changepoint detection method for monitoring distributed sensor networks
- Quickest changepoint detection in general multistream stochastic models: recent results, applications and future challenges
- Adaptive Partially Observed Sequential Change Detection and Isolation
- Bandit Change-Point Detection for Real-Time Monitoring High-Dimensional Data Under Sampling Control
- A latent variable model with change-points and its application to time pressure effects in educational assessment
- Optimal sequential detection by sparsity likelihood
- Impact of compensation coefficients on active sequential change point detection
- Online jump and kink detection in segmented linear regression: statistical optimality meets computational efficiency
- Dynamic statistical learning in massive datastreams
This page was built for publication: Optimal sequential detection in multi-stream data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q134124)
