General maximum likelihood empirical Bayes estimation of normal means
From MaRDI portal
Publication:2388976
Abstract: We propose a general maximum likelihood empirical Bayes (GMLEB) method for the estimation of a mean vector based on observations with i.i.d. normal errors. We prove that under mild moment conditions on the unknown means, the average mean squared error (MSE) of the GMLEB is within an infinitesimal fraction of the minimum average MSE among all separable estimators which use a single deterministic estimating function on individual observations, provided that the risk is of greater order than . We also prove that the GMLEB is uniformly approximately minimax in regular and weak balls when the order of the length-normalized norm of the unknown means is between and . Simulation experiments demonstrate that the GMLEB outperforms the James--Stein and several state-of-the-art threshold estimators in a wide range of settings without much down side.
Recommendations
- On regularized general empirical Bayes estimation of normal means
- scientific article; zbMATH DE number 1057577
- Empirical bayes estimation of the mean in a multivariate normal distribution
- On general maximum likelihood empirical Bayes estimation of heteroscedastic IID normal means
- Generalized maximum likelihood estimation of normal mixture densities
- A generalized maximum likelihood characterization of the normal distribution
- Empirical Bayesian estimation of normal variances and covariances
Cites work
- scientific article; zbMATH DE number 3122730 (Why is no real title available?)
- scientific article; zbMATH DE number 3124366 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 472960 (Why is no real title available?)
- scientific article; zbMATH DE number 524360 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 1057577 (Why is no real title available?)
- scientific article; zbMATH DE number 1850478 (Why is no real title available?)
- scientific article; zbMATH DE number 3068128 (Why is no real title available?)
- Adapting to Unknown Smoothness via Wavelet Shrinkage
- Adapting to unknown sparsity by controlling the false discovery rate
- Admissible Estimators, Recurrent Diffusions, and Insoluble Boundary Value Problems
- An algorithm for maximizing expected log investment return
- Compound decision theory and empirical Bayes methods
- Consistency of the Maximum Likelihood Estimator in the Presence of Infinitely Many Incidental Parameters
- Empirical Bayes on vector observations: An extension of Stein's method
- Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities.
- Estimation with quadratic loss.
- Gaussian model selection
- General empirical Bayes wavelet methods and exactly adaptive minimax estimation
- Generalized maximum likelihood estimation of normal mixture densities
- Ideal spatial adaptation by wavelet shrinkage
- Incorporating information on neighbouring coefficients into wavelet estimation
- Minimax multiple shrinkage estimation
- Minimax risk over \(l_ p\)-balls for \(l_ q\)-error
- Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
- Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
- Parametric Empirical Bayes Inference: Theory and Applications
- Posterior convergence rates of Dirichlet mixtures at smooth densities
- Robbins, empirical Bayes and microarrays
- Some thoughts on empirical Bayes estimation
- Stein's Estimation Rule and Its Competitors--An Empirical Bayes Approach
- The Empirical Bayes Approach to Statistical Decision Problems
- The risk inflation criterion for multiple regression
- Weak convergence and empirical processes. With applications to statistics
Cited in
(76)- Adaptive nonparametric empirical Bayes estimation via wavelet series: the minimax study
- Two modeling strategies for empirical Bayes estimation
- scientific article; zbMATH DE number 1057577 (Why is no real title available?)
- Approximate nonparametric maximum likelihood for mixture models: a convex optimization approach to fitting arbitrary multivariate mixing distributions
- A computationally efficient approach to estimating species richness and rarefaction curve
- Deconvolution for an atomic distribution: rates of convergence
- Generalized maximum likelihood estimation of the mean of parameters of mixtures. With applications to sampling and to observational studies
- A nonparametric empirical Bayes approach to large-scale multivariate regression
- The horseshoe estimator: posterior concentration around nearly black vectors
- The Poisson Compound Decision Problem Revisited
- Nonparametric empirical Bayes improvement of shrinkage estimators with applications to time series
- Comment: Minimalist \(g\)-modeling
- Comment: ``Bayes, oracle Bayes and empirical Bayes
- Comment: Empirical Bayes interval estimation
- Comment: Empirical Bayes, compound decisions and exchangeability
- Comment: Variational autoencoders as empirical Bayes
- Rate of divergence of the nonparametric likelihood ratio test for Gaussian mixtures
- Spike and slab empirical Bayes sparse credible sets
- A Regression Modeling Approach to Structured Shrinkage Estimation
- On spike and slab empirical Bayes multiple testing
- Minimax bounds for estimating multivariate Gaussian location mixtures
- SURE Estimates for a Heteroscedastic Hierarchical Model
- TESTING FOR HOMOGENEITY IN MIXTURE MODELS
- Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
- Optimal shrinkage estimation of mean parameters in family of distributions with quadratic variance
- Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
- An Empirical Bayes Method for Chi-Squared Data
- A nonparametric empirical Bayes approach to adaptive minimax estimation
- Empirical Bayes Mean Estimation With Nonparametric Errors Via Order Statistic Regression on Replicated Data
- A deconvolution path for mixtures
- On a Problem of Robbins
- On regularized general empirical Bayes estimation of normal means
- On the nonparametric maximum likelihood estimator for Gaussian location mixture densities with application to Gaussian denoising
- Irrational Exuberance: Correcting Bias in Probability Estimates
- Nonparametric empirical Bayes biomarker imputation and estimation
- Compound Sequential Change-point Detection in Parallel Data Streams
- A Compound Decision Approach to Covariance Matrix Estimation
- Wavelet Shrinkage Generalized Bayes Estimation for Multivariate Normal Distribution Mean Vectors with unknown Covariance Matrix under Balanced-LINEX Loss
- Empirical Bayes scaling of Gaussian priors in the white noise model
- Simultaneous estimation based on empirical likelihood and general maximum likelihood estimation
- High dimensional discriminant rules with shrinkage estimators of the covariance matrix and mean vector
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- Unobserved Heterogeneity in Income Dynamics: An Empirical Bayes Perspective
- Bayes, oracle Bayes and empirical Bayes
- A survey of nonparametric mixing density estimation via the predictive recursion algorithm
- A guided random walk through some high dimensional problems
- Simultaneous estimation of normal means with side information
- Learning Gaussian mixtures using the Wasserstein-Fisher-Rao gradient flow
- Poisson mean vector estimation with nonparametric maximum likelihood estimation and application to protein domain data
- Integrative genetic risk prediction using non-parametric empirical Bayes classification
- Asymptotically optimal nonparametric empirical Bayes via predictive recursion
- A Fast Algorithm for Maximum Likelihood Estimation of Mixture Proportions Using Sequential Quadratic Programming
- Two-sample test with \(g\)-modeling and its applications
- A general framework for empirical Bayes estimation in discrete linear exponential family
- Group-linear empirical Bayes estimates for a heteroscedastic normal mean
- Optimal stopping and worker selection in crowdsourcing: an adaptive sequential probability ratio test framework
- ebTobit
- High-dimensional linear discriminant analysis using nonparametric methods
- No need for an oracle: the nonparametric maximum likelihood decision in the compound decision problem is minimax
- Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules
- On general maximum likelihood empirical Bayes estimation of heteroscedastic IID normal means
- Empirical priors and coverage of posterior credible sets in a sparse normal mean model
- SURE estimates for high dimensional classification
- Generalized Bayesian shrinkage and wavelet estimation of location parameter for spherical distribution under balance-type loss: minimaxity and admissibility
- Empirical priors and posterior concentration in a piecewise polynomial sequence model
- On the normalized maximum likelihood and Bayesian decision theory
- Meta-analysis with fixed, unknown, study-specific parameters
- Statistical theory powering data science
- Robust empirical Bayes confidence intervals
- A Gaussian compound decision bakeoff
- Consistency of the generalized likelihood ratio test for heteroscedastic normal mixtures
- Estimating the mean and variance of a high-dimensional normal distribution using a mixture prior
- Empirical Bayes analysis of spike and slab posterior distributions
- Confidence Intervals for Nonparametric Empirical Bayes Analysis
- Efficient empirical Bayes estimates for risk parameters of Pareto distributions
- Rejoinder: ``Bayes, oracle Bayes, and empirical Bayes
This page was built for publication: General maximum likelihood empirical Bayes estimation of normal means
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2388976)
