A statistical analysis of noisy crowdsourced weather data

DOI10.1214/19-AOAS1290zbMATH Open1439.62235arXiv1902.06183OpenAlexW3016745651MaRDI QIDQ2179947FDOQ2179947

Authors: Yanyan Li 

Publication date: 13 May 2020

Published in: The Annals of Applied Statistics (Search for Journal in Brave)

Abstract: Spatial prediction of weather-elements like temperature, precipitation, and barometric pressure are generally based on satellite imagery or data collected at ground-stations. None of these data provide information at a more granular or "hyper-local" resolution. On the other hand, crowdsourced weather data, which are captured by sensors installed on mobile devices and gathered by weather-related mobile apps like WeatherSignal and AccuWeather, can serve as potential data sources for analyzing environmental processes at a hyper-local resolution. However, due to the low quality of the sensors and the non-laboratory environment, the quality of the observations in crowdsourced data is compromised. This paper describes methods to improve hyper-local spatial prediction using this varying-quality noisy crowdsourced information. We introduce a reliability metric, namely Veracity Score (VS), to assess the quality of the crowdsourced observations using a coarser, but high-quality, reference data. A VS-based methodology to analyze noisy spatial data is proposed and evaluated through extensive simulations. The merits of the proposed approach are illustrated through case studies analyzing crowdsourced daily average ambient temperature readings for one day in the contiguous United States.

Full work available at URL: https://arxiv.org/abs/1902.06183

Recommendations

• Fine-Scale Spatiotemporal Air Pollution Analysis Using Mobile Monitors on Google Street View Vehicles
• Spatial prediction and spatial dependence monitoring on georeferenced data streams
• scientific article; zbMATH DE number 7117702
• Improving the simultaneous application of the DSN-PC and NOAA GFS datasets
• Big data sampling and spatial analysis: ``which of the two ladles, of fig-wood or gold, is appropriate to the soup and the pot?

zbMATH Keywords

geostatisticshyperlocal spatial predictionrobust Krigingveracity score

Mathematics Subject Classification ID

Nonparametric robustness (62G35) Directional data; spatial statistics (62H11) Inference from stochastic processes and prediction (62M20) Applications of statistics to environmental and related topics (62P12) Geostatistics (86A32) Applications of statistics to physics (62P35)

Cites Work

• Title not available (Why is that?)
• Strictly and non-strictly positive definite functions on spheres
• Resampling methods for dependent data
• Handbook of spatial statistics.
• Title not available (Why is that?)
• Robust Statistics
• Properties of nonparametric estimators of autocovariance for stationary random fields
• Sharpening Wald-type inference in robust regression for small samples
• Bootstrapping the sample quantile of a weakly dependent sequence
• A New Proof of the Bahadur Representation of Quantiles and an Application
• Highly robust variogram estimation
• Asymptotic Normality of Sample Quantiles for $m$-Dependent Processes
• On asymptotic distribution and asymptotic efficiency of least squares estimators of spatial variogram parameters
• Multivariate spatial outlier detection using robust geographically weighted methods
• A statistical analysis of noisy crowdsourced weather data

Cited In (1)

• A statistical analysis of noisy crowdsourced weather data

Uses Software

• robustbase
• rrcov
• georob
• AccuWeather
• WeatherSignal
• Dark Sky

This page was built for publication: A statistical analysis of noisy crowdsourced weather data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2179947)