Power-law distributions in binned empirical data
From MaRDI portal
Publication:2453658
Abstract: Many man-made and natural phenomena, including the intensity of earthquakes, population of cities and size of international wars, are believed to follow power-law distributions. The accurate identification of power-law patterns has significant consequences for correctly understanding and modeling complex systems. However, statistical evidence for or against the power-law hypothesis is complicated by large fluctuations in the empirical distribution's tail, and these are worsened when information is lost from binning the data. We adapt the statistically principled framework for testing the power-law hypothesis, developed by Clauset, Shalizi and Newman, to the case of binned data. This approach includes maximum-likelihood fitting, a hypothesis test based on the Kolmogorov--Smirnov goodness-of-fit statistic and likelihood ratio tests for comparing against alternative explanations. We evaluate the effectiveness of these methods on synthetic binned data with known structure, quantify the loss of statistical power due to binning, and apply the methods to twelve real-world binned data sets with heavy-tailed patterns.
Recommendations
Cites work
- A Brief History of Generative Models for Power Law and Lognormal Distributions
- A simple general approach to inference about the tail of a distribution
- Bayes Factors
- Critical phenomena in natural sciences. Chaos, fractals, selforganization and disorder: Concepts and tools.
- Critical Truths About Power Laws
- Editorial: The Future of Power Law Research
- Estimating Heavy-Tail Exponents Through Max Self–Similarity
- Estimating the historical and future probabilities of large terrorist events
- Fitting Mixture Models to Grouped and Truncated Data via the EM Algorithm
- Generalized least-squares estimators for the thickness of heavy tails
- Goodness-of-Fit Tests for Discrete Data: A Review and an Application to a Health Impairment Scale
- scientific article; zbMATH DE number 3141647 (Why is no real title available?)
- scientific article; zbMATH DE number 5604057 (Why is no real title available?)
- scientific article; zbMATH DE number 3824949 (Why is no real title available?)
- scientific article; zbMATH DE number 4111797 (Why is no real title available?)
- scientific article; zbMATH DE number 3483405 (Why is no real title available?)
- scientific article; zbMATH DE number 3609402 (Why is no real title available?)
- scientific article; zbMATH DE number 708500 (Why is no real title available?)
- scientific article; zbMATH DE number 735225 (Why is no real title available?)
- scientific article; zbMATH DE number 1069355 (Why is no real title available?)
- scientific article; zbMATH DE number 2038320 (Why is no real title available?)
- scientific article; zbMATH DE number 274399 (Why is no real title available?)
- scientific article; zbMATH DE number 5204924 (Why is no real title available?)
- scientific article; zbMATH DE number 3047111 (Why is no real title available?)
- scientific article; zbMATH DE number 3097675 (Why is no real title available?)
- Inaccuracy of the X 2 Test of Goodness of Fit when Expected Frequenies are Small
- Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
- Likelihood-based inference for stochastic models of sexual network formation
- Maximum likelihood estimation of mixture densities for binned and truncated multivariate data
- Note on the Kolmogorov statistic in the discrete case
- Optimal choice of sample fraction in extreme-value estimation
- Power-law distributions in binned empirical data
- Power-law distributions in empirical data
- Robust confidence bounds for extreme upper quantiles
- Selecting the optimal sample fraction in univariate extreme value estimation
- The qq-estimator and heavy tails
- Using a bootstrap method to choose the sample fraction in tail index estimation
Cited in
(23)- Identifying systemically important financial institutions: a network approach
- Testing equivalence to power law distributions
- A novel complex network based dynamic rule selection approach for open shop scheduling problem with release dates
- Power-law distributions in binned empirical data
- Universal characteristics of fractal fluctuations in prime number distribution
- Power-law distributions in empirical data
- Analyzing complex functional brain networks: fusing statistics and network science to understand the brain
- Power Laws and Skew Distributions
- Power law and entropy analysis of catastrophic phenomena
- On a minimum distance procedure for threshold selection in tail analysis
- The power-law distribution of agricultural land size
- Penalized KS method to fit data sets with power law distribution over a bounded subinterval
- Measuring multiscaling in financial time-series
- scientific article; zbMATH DE number 7415108 (Why is no real title available?)
- A computational approach to estimation of discrete Pareto parameters
- A discrete truncated Zipf distribution
- Power-law distribution in pieces: a semi-parametric approach with change point detection
- A novel agent model of heterogeneous risk based on temporal interaction network for stock price simulation
- A minimal agent-based model for the size-frequency distribution of firms
- Multiple outlier detection in samples with exponential & Pareto tails
- Modeling variance risk in financial markets using power-laws: new evidence from the Garman-Klass variance estimator
- Extremal dependence networks for mitigating systemic risk via maximum independent sets
- Asymptotic independence and support detection techniques for heavy-tailed multivariate data
This page was built for publication: Power-law distributions in binned empirical data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2453658)
