Hot-spots detection in count data by Poisson assisted smooth sparse tensor decomposition

DOI10.1080/02664763.2022.2112557MaRDI QIDQ6063317zbMATH OpenWikidataFDO

Authors Yujie Zhao, Xiaoming Huo, Yajun Mei

Publication date 7 November 2023

Published in Journal of Applied Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2205.10447

zbMATH Keywords

CUSUMhot-spots detectionPoisson regressionspatio-temporal modeltensor decomposition

Mathematics Subject Classification ID

Statistics (62-XX)

Abstract: Count data occur widely in many bio-surveillance and healthcare applications, e.g., the numbers of new patients of different types of infectious diseases from different cities/counties/states repeatedly over time, say, daily/weekly/monthly. For this type of count data, one important task is the quick detection and localization of hot-spots in terms of unusual infectious rates so that we can respond appropriately. In this paper, we develop a method called Poisson assisted Smooth Sparse Tensor Decomposition (PoSSTenD), which not only detects when hot-spots occur but also localizes where hot-spots occur. The main idea of our proposed PoSSTenD method is articulated as follows. First, we represent the observed count data as a three-dimensional tensor including (1) a spatial dimension for location patterns, e.g., different cities/countries/states; (2) a temporal domain for time patterns, e.g., daily/weekly/monthly; (3) a categorical dimension for different types of data sources, e.g., different types of diseases. Second, we fit this tensor into a Poisson regression model, and then we further decompose the infectious rate into two components: smooth global trend and local hot-spots. Third, we detect when hot-spots occur by building a cumulative sum (CUSUM) control chart and localize where hot-spots occur by their LASSO-type sparse estimation. The usefulness of our proposed methodology is validated through numerical simulation studies and a real-world dataset, which records the annual number of 10 different infectious diseases from 1993 to 2018 for 49 mainland states in the United States.

Cites work

• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• A space-time scan statistic for detecting emerging outbreaks
• A spatial scan statistic
• An iterative thresholding algorithm for linear inverse problems with a sparsity constraint
• CONTINUOUS INSPECTION SCHEMES
• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• scientific article; zbMATH DE number 6438182 (Why is no real title available?)
• scientific article; zbMATH DE number 3253638 (Why is no real title available?)
• Instrument search in pseudo-likelihood approach for nonignorable nonresponse
• Multivariate statistical process control using Lasso
• On Information and Sufficiency
• Order thresholding
• Procedures for Reacting to a Change in Distribution
• Prospective Time Periodic Geographical Disease Surveillance Using a Scan Statistic
• Proximal algorithms in statistics and machine learning
• Pseudo likelihood and dimension reduction for data with nonignorable nonresponse
• Scalable sum-shrinkage schemes for distributed monitoring large-scale data streams
• Semiparametric inference for estimating equations with nonignorably missing covariates
• Semiparametric likelihood for estimating equations with non-ignorable non-response by non-response instrument
• Some nondegenerate limit laws for the selection differential
• Tensor Decompositions and Applications
• The elements of statistical learning. Data mining, inference, and prediction

Cited in

(2)

• Rapid detection of hot-spots via tensor decomposition with applications to crime rate data
• Editorial to the special issue: modern streaming data analytics

This page was built for publication: Hot-spots detection in count data by Poisson assisted smooth sparse tensor decomposition

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6063317)