A statistical analysis of noisy crowdsourced weather data

DOI10.1214/19-AOAS1290MaRDI QIDQ2179947zbMATH OpenOpenAlexFDO

Authors Yanyan Li

Publication date 13 May 2020

Published in The Annals of Applied Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1902.06183, https://projecteuclid.org/euclid.aoas/1587002667

zbMATH Keywords

geostatisticshyperlocal spatial predictionrobust Krigingveracity score

Mathematics Subject Classification ID

Nonparametric robustness (62G35) Directional data; spatial statistics (62H11) Inference from stochastic processes and prediction (62M20) Applications of statistics to environmental and related topics (62P12) Applications of statistics to physics (62P35) Geostatistics (86A32)

Abstract: Spatial prediction of weather-elements like temperature, precipitation, and barometric pressure are generally based on satellite imagery or data collected at ground-stations. None of these data provide information at a more granular or "hyper-local" resolution. On the other hand, crowdsourced weather data, which are captured by sensors installed on mobile devices and gathered by weather-related mobile apps like WeatherSignal and AccuWeather, can serve as potential data sources for analyzing environmental processes at a hyper-local resolution. However, due to the low quality of the sensors and the non-laboratory environment, the quality of the observations in crowdsourced data is compromised. This paper describes methods to improve hyper-local spatial prediction using this varying-quality noisy crowdsourced information. We introduce a reliability metric, namely Veracity Score (VS), to assess the quality of the crowdsourced observations using a coarser, but high-quality, reference data. A VS-based methodology to analyze noisy spatial data is proposed and evaluated through extensive simulations. The merits of the proposed approach are illustrated through case studies analyzing crowdsourced daily average ambient temperature readings for one day in the contiguous United States.

Recommendations

• Fine-Scale Spatiotemporal Air Pollution Analysis Using Mobile Monitors on Google Street View Vehicles
• Spatial prediction and spatial dependence monitoring on georeferenced data streams
• scientific article; zbMATH DE number 7117702
• Improving the simultaneous application of the DSN-PC and NOAA GFS datasets
• Big data sampling and spatial analysis: ``which of the two ladles, of fig-wood or gold, is appropriate to the soup and the pot?

Cites work

• A New Proof of the Bahadur Representation of Quantiles and an Application
• A statistical analysis of noisy crowdsourced weather data
• Asymptotic Normality of Sample Quantiles for m-Dependent Processes
• Bootstrapping the sample quantile of a weakly dependent sequence
• Handbook of spatial statistics.
• Highly robust variogram estimation
• scientific article; zbMATH DE number 3863589 (Why is no real title available?)
• scientific article; zbMATH DE number 52492 (Why is no real title available?)
• Multivariate spatial outlier detection using robust geographically weighted methods
• On asymptotic distribution and asymptotic efficiency of least squares estimators of spatial variogram parameters
• Properties of nonparametric estimators of autocovariance for stationary random fields
• Resampling methods for dependent data
• Robust Statistics
• Sharpening Wald-type inference in robust regression for small samples
• Strictly and non-strictly positive definite functions on spheres

Cited in

(3)

• A statistical analysis of noisy crowdsourced weather data
• On Statistical Properties of a Veracity Scoring Method for Spatial Data
• Enhancing the accuracy of spatio-temporal models for wind speed prediction by incorporating bias-corrected crowdsourced data

Describes a project that uses

Uses Software

• robustbase
• rrcov
• georob
• Dark Sky
• AccuWeather
• WeatherSignal

This page was built for publication: A statistical analysis of noisy crowdsourced weather data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2179947)