Can p-values be meaningfully interpreted without random sampling?
The main focus of the paper is on `\(p\)-values' and inductive statistical inference relating to estimation and testing of hypotheses about unknown population parameters based on samples drawn from the population. In economics and social sciences, on certain occasions, random sampling is not adhered to and non random selection using observational methods such as convenience sampling, purposive sampling, voluntary selection among others is followed. The authors note that the assumptions and conditions for using \(p\)-values for inference are not usually satisfied and caution that fallacious conclusions may result. They consider, in detail, simple random sampling, stratified sampling and cluster sampling techniques and suggest the adjustments for calculating meaningful standard errors and \(p\)-values. The use of propensity scores is also discussed. Furthermore, they also study the situations leading to a 100\% sampling such as analyzing aggregate economic data. Finally, the authors refer to a host of recent publications criticizing the use of \(p\)-values incorrectly. There is a long list of useful references at the end of the paper.
- Pitfalls of significance testing and \(p\)-value variability: an econometrics perspective
- The use of p-values in applied research: interpretation and new trends
- A holistic approach to empirical analysis: the insignificance of \(P\), hypothesis testing and statistical significance
- On the Validity of Inferences from Non-random Sample
- Non-asymptotic tests of model performance
- Causal inference for statistics, social, and biomedical sciences. An introduction
- Clustered data with small sample sizes: comparing the performance of model-based and design-based approaches
- Design of observational studies
- Five Nonobvious Changes in Editorial Practice for Editors and Reviewers to Consider When Evaluating Submissions in a Post p < 0.05 Universe
- scientific article; zbMATH DE number 5851866 (Why is no real title available?)
- scientific article; zbMATH DE number 5284790 (Why is no real title available?)
- scientific article; zbMATH DE number 1086071 (Why is no real title available?)
- scientific article; zbMATH DE number 1834445 (Why is no real title available?)
- scientific article; zbMATH DE number 3242901 (Why is no real title available?)
- Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
- Microeconometrics
- Microeconometrics using Stata
- Moving to a World Beyond “p < 0.05”
- Pitfalls of significance testing and \(p\)-value variability: an econometrics perspective
- Practical tools for designing and weighting survey samples
- Sample Selection Bias as a Specification Error
- Sample Selection Bias as a Specification Error: A Comment
- Sampling: design and analysis
- The ASA Statement on p-Values: Context, Process, and Purpose
- Two-step estimation of panel data models with censored endogenous variables and selection bias
- Non-asymptotic tests of model performance
- A holistic approach to empirical analysis: the insignificance of \(P\), hypothesis testing and statistical significance
- The widespread misinterpretation of \(p\)-values as error probabilities
- scientific article; zbMATH DE number 7273237 (Why is no real title available?)
- On the correct interpretation of \(p\) values and the importance of random variables
- scientific article; zbMATH DE number 7716253 (Why is no real title available?)
This page was built for publication: Can \(p\)-values be meaningfully interpreted without random sampling?
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2191897)
