Changepoint Detection in the Presence of Outliers
From MaRDI portal
Publication:5229902
DOI10.1080/01621459.2017.1385466zbMATH Open1478.62238arXiv1609.07363OpenAlexW2525449401MaRDI QIDQ5229902FDOQ5229902
Guillem Rigaill, Paul Fearnhead
Publication date: 19 August 2019
Published in: Journal of the American Statistical Association (Search for Journal in Brave)
Abstract: Many traditional methods for identifying changepoints can struggle in the presence of outliers, or when the noise is heavy-tailed. Often they will infer additional changepoints in order to fit the outliers. To overcome this problem, data often needs to be pre-processed to remove outliers, though this is difficult for applications where the data needs to be analysed online. We present an approach to changepoint detection that is robust to the presence of outliers. The idea is to adapt existing penalised cost approaches for detecting changes so that they use loss functions that are less sensitive to outliers. We argue that loss functions that are bounded, such as the classical biweight loss, are particularly suitable -- as we show that only bounded loss functions are robust to arbitrarily extreme outliers. We present an efficient dynamic programming algorithm that can find the optimal segmentation under our penalised cost criteria. Importantly, this algorithm can be used in settings where the data needs to be analysed online. We show that we can consistently estimate the number of changepoints, and accurately estimate their locations, using the biweight loss function. We demonstrate the usefulness of our approach for applications such as analysing well-log data, detecting copy number variation, and detecting tampering of wireless devices.
Full work available at URL: https://arxiv.org/abs/1609.07363
Recommendations
- scientific article; zbMATH DE number 1916873
- A robust changepoint detection method
- Detecting change-points in extremes
- Change Point Detection in a General Class of Distributions
- Detection of change points: a survey of methodologies
- Changepoint detection in non-exchangeable data
- Outlier-resistant algorithms for detecting a change in a stochastic process
Robustness and adaptive procedures (parametric inference) (62F35) Non-Markovian processes: hypothesis testing (62M07)
Cites Work
- Wild binary segmentation for multiple change-point detection
- On optimal multiple changepoint algorithms for large data
- A computationally efficient nonparametric approach for changepoint detection
- Least-squares estimation of an unknown number of shifts in a time series
- Changepoint estimation: another look at multiple testing problems
- Title not available (Why is that?)
- Optimal Detection of Changepoints With a Linear Computational Cost
- Circular binary segmentation for the analysis of array-based DNA copy number data
- Multiscale Change Point Inference
- CONTINUOUS INSPECTION SCHEMES
- A pruned dynamic programming algorithm to recover the best segmentations with 1 to \(K_{\max}\) change-points
- Inference about the change-point from cumulative sum tests
- Estimation of a noisy discrete-time step function: Bayes and empirical Bayes approaches
- International Encyclopedia of Statistical Science
- On the Likelihood Ratio Test for a Shift in Location of Normal Populations
- Numerical Bayesian Methods Applied to Signal Processing
- A pairwise likelihood-based approach for changepoint detection in multivariate time series models
- Title not available (Why is that?)
- Approximate simulation-free Bayesian inference for multiple changepoint models with dependence within segments
- An exact approach to Bayesian sequential change point detection
- M-Procedures for Detection of Changes for Dependent Observations
Cited In (34)
- Robust algorithms for multiphase regression models
- On optimal segmentation and parameter tuning for multiple change-point detection and inference
- Most recent changepoint detection in censored panel data
- Changepoint detection in non-exchangeable data
- Bayesian Change Point Detection with Spike-and-Slab Priors
- BOOTSTRAP INFERENCE FOR MULTIPLE CHANGE-POINTS IN TIME SERIES
- Cross-validation for change-point regression: pitfalls and solutions
- Is a finite intersection of balls covered by a finite union of balls in Euclidean spaces?
- Multiscale Quantile Segmentation
- Sequential change-point detection: computation versus statistical performance
- A Composite Likelihood-Based Approach for Change-Point Detection in Spatio-Temporal Processes
- Detecting changes in the transmission rate of a stochastic epidemic model
- Scalable change-point and anomaly detection in cross-correlated data with an application to condition monitoring
- Most Recent Changepoint Detection in Panel Data
- Title not available (Why is that?)
- Bayesian multiple changepoint detection with missing data and its application to the magnitude-frequency distributions
- Scalable multiple changepoint detection for functional data sequences
- Sequential change point test in the presence of outliers: the density power divergence based approach
- Multiple change-point detection for regression curves
- Detecting Abrupt Changes in the Presence of Local Fluctuations and Autocorrelated Noise
- Multipartition model for multiple change point identification
- Scalable Bayesian Multiple Changepoint Detection via Auxiliary Uniformisation
- Alternating Pruned Dynamic Programming for Multiple Epidemic Change-Point Estimation
- Localising change points in piecewise polynomials of general degrees
- Optimal nonparametric change point analysis
- Rank-based multiple change-point detection
- Subset Multivariate Collective and Point Anomaly Detection
- Real Time Anomaly Detection And Categorisation
- Graphical Influence Diagnostics for Changepoint Models
- Monitoring procedures for strict stationarity based on the multivariate characteristic function
- Loss function-based change point detection in risk measures
- Relating and comparing methods for detecting changes in mean
- Consistency of a range of penalised cost approaches for detecting multiple changepoints
- Parallelization of a Common Changepoint Detection Method
Uses Software
This page was built for publication: Changepoint Detection in the Presence of Outliers
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5229902)
