Approximate query processing using wavelets
Approximate query processing has emerged as a cost-effective approach for dealing with the huge data volumes and stringent response-time requirements of today's decision support systems (DSS). Most work in this area, however, has so far been limited in its query processing scope, typically focusing on specific forms of aggregate queries. Furthermore, conventional approaches based on sampling or histograms appear to be inherently limited when it comes to approximating the results of complex queries over high-dimensional DSS data sets. In this paper, we propose the use of multi-dimensional wavelets as an effective tool for general-purpose approximate query processing in modern, high-dimensional applications. Our approach is based on building wavelet-coefficient synopses of the data and using these synopses to provide approximate answers to queries. We develop novel query processing algorithms that operate directly on the wavelet-coefficient synopses of relational tables, allowing us to process arbitrarily complex queries entirely in the wavelet-coefficient domain. This guarantees extremely fast response times since our approximate query execution engine can do the bulk of its processing over compact sets of wavelet coefficients, essentially postponing the expansion into relational tuples until the end-result of the query. We also propose a novel wavelet decomposition algorithm that can build these synopses in an I/O-efficient manner. Finally, we conduct an extensive experimental study with synthetic as well as real-life data sets to determine the effectiveness of our wavelet-based approach compared to sampling and histograms. Our results demonstrate that our techniques: (1) provide approximate answers of better quality than either sampling or histograms; (2) offer query execution-time speedups of more than two orders of magnitude; and (3) guarantee extremely fast synopsis construction times that scale linearly with the size of the data.
- Progressive evaluation of nested aggregate queries
- Compressed data cube for approximate OLAP query processing.
- Computing unrestricted synopses under maximum error bound
- AMID: approximation of multi-measured data using SVD
- Wavelet transformation-based management of integrated summary data for distributed query processing
- An outliers divide-and-conquers sampling algorithm for approximate aggregation queries
- scientific article; zbMATH DE number 2086301 (Why is no real title available?)
- Linked-tree: An aggregate query algorithm based on sliding window over data stream
- scientific article; zbMATH DE number 1945814 (Why is no real title available?)
- scientific article; zbMATH DE number 1755734 (Why is no real title available?)
- A probabilistic framework for estimating the accuracy of aggregate range queries evaluated over histograms
- scientific article; zbMATH DE number 1834541 (Why is no real title available?)
- A Bayesian method for query approximation
- Making big data small
- Database Theory - ICDT 2005
- Inner-Product Based Wavelet Synopses for Range-Sum Queries
- Optimal workload-based weighted wavelet synopses
This page was built for publication: Approximate query processing using wavelets
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1606832)
