Empirical Bayes Mean Estimation With Nonparametric Errors Via Order Statistic Regression on Replicated Data

DOI10.1080/01621459.2021.1967164MaRDI QIDQ6165286zbMATH OpenOpenAlexFDO

Authors Nikolaos Ignatiadis, Sujayam Saha, Dennis L. Sun, Omkar Muralidharan

Publication date 4 July 2023

Published in Journal of the American Statistical Association (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1911.05970

zbMATH Keywords

asymptotic optimalityempirical BayesL-statisticslinear regressionnonparametric regression

Mathematics Subject Classification ID

Statistics (62-XX)

Abstract: We study empirical Bayes estimation of the effect sizes of $N$ units from $K$ noisy observations on each unit. We show that it is possible to achieve near-Bayes optimal mean squared error, without any assumptions or knowledge about the effect size distribution or the noise. The noise distribution can be heteroskedastic and vary arbitrarily from unit to unit. Our proposal, which we call Aurora, leverages the replication inherent in the $K$ observations per unit and recasts the effect size estimation problem as a general regression problem. Aurora with linear regression provably matches the performance of a wide array of estimators including the sample mean, the trimmed mean, the sample median, as well as James-Stein shrunk versions thereof. Aurora automates effect size estimation for Internet-scale datasets, as we demonstrate on data from a large technology firm.

Cites work

• A Class of Statistics with Asymptotically Normal Distribution
• A distribution-free theory of nonparametric regression
• A Method to Increase the Power of Multiple Testing Procedures Through Sample Splitting
• A note on data-splitting for the evaluation of significance levels
• A supplementary sample non-parametric empirical Bayes approach to some statistical decision problems
• Adaptive sparse estimation with side information
• ALIGNING OF ESTIMATES: AN ALTERNATIVE TO EMPIRICAL BAYES METHODS
• Asymptotic Distribution of Linear Combinations of Functions of Order Statistics with Applications to Estimation
• Asymptotic Statistics
• Big and complex data analysis. Methodologies and applications
• Compound \(p\)-value statistics for multiple testing procedures
• Conjugate priors for exponential families
• Consistency of the Maximum Likelihood Estimator in the Presence of Infinitely Many Incidental Parameters
• Consistent nonparametric regression. Discussion
• Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules
• Covariate Powered Cross-Weighted Multiple Testing
• Deconvolution from panel data with unknown error distribution
• Double/debiased machine learning for treatment and structural parameters
• Empirical Bayes credibility
• Empirical simulation extrapolation for measurement error models with replicate measurements.
• Estimation of Nonlinear Models with Measurement Error
• Estimation with quadratic loss.
• From Fixed-X to Random-X Regression: Bias-Variance Decompositions, Covariance Penalties, and Prediction Error Estimation
• General maximum likelihood empirical Bayes estimation of normal means
• Group-linear empirical Bayes estimates for a heteroscedastic normal mean
• High dimensional exponential family estimation via empirical Bayes
• High-dimensional regression adjustments in randomized experiments
• scientific article; zbMATH DE number 3124347 (Why is no real title available?)
• scientific article; zbMATH DE number 3124366 (Why is no real title available?)
• scientific article; zbMATH DE number 3860199 (Why is no real title available?)
• scientific article; zbMATH DE number 1181283 (Why is no real title available?)
• scientific article; zbMATH DE number 1750180 (Why is no real title available?)
• scientific article; zbMATH DE number 4113757 (Why is no real title available?)
• scientific article; zbMATH DE number 6122810 (Why is no real title available?)
• scientific article; zbMATH DE number 3297735 (Why is no real title available?)
• Inference in components of variance models with low replication
• Julia: a fresh approach to numerical computing
• Kernel estimation for panel data with heterogeneous dynamics
• Least squares estimation in the monotone single index model
• Linear Models and Empirical Bayes Methods for Assessing Differential Expression in Microarray Experiments
• Local Linear Forests
• Non-Parametric Empirical Bayes Procedures
• Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
• Nonparametric shape-restricted regression
• On linear estimates defined by a continuous weight function
• On the nonparametric maximum likelihood estimator for Gaussian location mixture densities with application to Gaussian denoising
• Optimal linear estimators of location and scale parameters using order statistics and related empirical Bayes estimation
• Optimal linear estimators: an empirical Bayes version with application to the binomial distribution
• Semiparametric Estimation of Regression Models for Panel Data
• Small area estimation
• Some thoughts on empirical Bayes estimation
• Stein's Estimation Rule and Its Competitors--An Empirical Bayes Approach
• Steinized empirical Bayes estimation for heteroscedastic data
• SURE Estimates for a Heteroscedastic Hierarchical Model
• The 1988 Neyman Memorial Lecture: A Galtonian perspective on shrinkage estimators
• The Empirical Bayes Approach to Statistical Decision Problems
• The jackknife estimate of variance

Cited in

(5)

• Nonparametric empirical Bayes prediction in mixed models
• Rejoinder
• Empirical Bayes Estimation via Data Fission
• Data Fission: Splitting a Single Data Point
• Empirical partially Bayes multiple testing and compound ^2 decisions

This page was built for publication: Empirical Bayes Mean Estimation With Nonparametric Errors Via Order Statistic Regression on Replicated Data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6165286)