Optimal sampling designs for multidimensional streaming time series with application to power grid sensor data
From MaRDI portal
Publication:6138630
Abstract: The Internet of Things (IoT) system generates massive high-speed temporally correlated streaming data and is often connected with online inference tasks under computational or energy constraints. Online analysis of these streaming time series data often faces a trade-off between statistical efficiency and computational cost. One important approach to balance this trade-off is sampling, where only a small portion of the sample is selected for the model fitting and update. Motivated by the demands of dynamic relationship analysis of IoT system, we study the data-dependent sample selection and online inference problem for a multi-dimensional streaming time series, aiming to provide low-cost real-time analysis of high-speed power grid electricity consumption data. Inspired by D-optimality criterion in design of experiments, we propose a class of online data reduction methods that achieve an optimal sampling criterion and improve the computational efficiency of the online analysis. We show that the optimal solution amounts to a strategy that is a mixture of Bernoulli sampling and leverage score sampling. The leverage score sampling involves auxiliary estimations that have a computational advantage over recursive least squares updates. Theoretical properties of the auxiliary estimations involved are also discussed. When applied to European power grid consumption data, the proposed leverage score based sampling methods outperform the benchmark sampling method in online estimation and prediction. The general applicability of the sampling-assisted online estimation method is assessed via simulation studies.
Cites work
- scientific article; zbMATH DE number 45785 (Why is no real title available?)
- scientific article; zbMATH DE number 777596 (Why is no real title available?)
- scientific article; zbMATH DE number 7625175 (Why is no real title available?)
- scientific article; zbMATH DE number 2199188 (Why is no real title available?)
- A statistical perspective on algorithmic leveraging
- Adjustment of an Inverse Matrix Corresponding to a Change in One Element of a Given Matrix
- Bayesian forecasting and dynamic models.
- Copula-based semiparametric models for multivariate time series
- Detection of Influential Observation in Linear Regression
- Dynamic Linear Models with R
- Fast approximation of matrix coherence and statistical leverage
- Inference of time-varying regression models
- Information-Based Optimal Subdata Selection for Big Data Linear Regression
- Large sample inference for long memory processes
- LowCon: A Design-based Subsampling Approach in a Misspecified Linear Model
- Moment bounds for stationary mixing sequences
- Monte Carlo strategies in scientific computing.
- On statistics, computation and scalability
- On the sequential construction of optimum bounded designs
- Online Censoring for Large-Scale Regressions with Application to Streaming Big Data
- Optimal Design of Experiments
- Optimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators With Massive Data
- Optimal subsampling for large sample logistic regression
- Orthogonal subsampling for big data linear regression
- Principles of Optimal Design
- SOME THEOREMS IN LEAST SQUARES
- Sampling Algorithms and Coresets for $\ell_p$ Regression
- Sequential online subsampling for thinning experimental designs
- Simultaneous Inference of Linear Models with Time Varying Coefficients
- Sketching as a tool for numerical linear algebra
- Time series analysis. Forecasting and control
- Turning big data into tiny data: constant-size coresets for \(k\)-means, PCA and projective clustering
This page was built for publication: Optimal sampling designs for multidimensional streaming time series with application to power grid sensor data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6138630)
