Statistical profile estimation in database systems
A statistical profile summarizes the instances of a database. It describes aspects such as the number of tuples, the number of values, the distribution of values, the correlation between value sets, and the distribution of tuples among secondary storage units. Estimation of database profiles is critical in the problems of query optimization, physical database design, and database performance prediction. This paper describes a model of a database profile, relates this model to estimating the cost of database operations, and surveys methods of estimating profiles. The operators and objects in the model include build profile, estimate profile, and update profile. The estimate operator is classified by the relational algebra operator (select, project, join), the property to be estimated (cardinality, distribution of values, and other parameters), and the underlying method (parametric, nonparametric, and ad-hoc). The accuracy, overhead, and assumptions of the methods are discussed in detail. Relevant research in both the database and the statistics disciplines is incorporated in the detailed discussion.
- Approximate similarity search: a multi-faceted problem
- SIAM: Statistic information access method
- Join sizes, urn models and normal limiting distributions
- Occupancy urn models in the analysis of algorithms
- Extension of the one-shot semijoin strategy to minimize data transmission cost in distributed query processing
- Join cardinality estimation by combining operator-level deep neural networks
- A formal analysis of why heuristic functions work
- Determining optimal binary inter-relational clustering schema for a relational database*
- Multiway spatial joins
- DFT techniques for size estimation of database join operations
- Dynamic analysis of some relational databases parameters
- Analysis of tradeoff between data accuracy and performance of databases
- How to estimate the sizes of domains
- An extensible model of selectivity estimation
This page was built for publication: Statistical profile estimation in database systems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3811768)