General maximum likelihood empirical Bayes estimation of normal means
From MaRDI portal
Publication:2388976
Abstract: We propose a general maximum likelihood empirical Bayes (GMLEB) method for the estimation of a mean vector based on observations with i.i.d. normal errors. We prove that under mild moment conditions on the unknown means, the average mean squared error (MSE) of the GMLEB is within an infinitesimal fraction of the minimum average MSE among all separable estimators which use a single deterministic estimating function on individual observations, provided that the risk is of greater order than . We also prove that the GMLEB is uniformly approximately minimax in regular and weak balls when the order of the length-normalized norm of the unknown means is between and . Simulation experiments demonstrate that the GMLEB outperforms the James--Stein and several state-of-the-art threshold estimators in a wide range of settings without much down side.
Recommendations
- On regularized general empirical Bayes estimation of normal means
- scientific article; zbMATH DE number 1057577
- Empirical bayes estimation of the mean in a multivariate normal distribution
- On general maximum likelihood empirical Bayes estimation of heteroscedastic IID normal means
- Generalized maximum likelihood estimation of normal mixture densities
- A generalized maximum likelihood characterization of the normal distribution
- Empirical Bayesian estimation of normal variances and covariances
Cites work
- Adapting to Unknown Smoothness via Wavelet Shrinkage
- Adapting to unknown sparsity by controlling the false discovery rate
- Admissible Estimators, Recurrent Diffusions, and Insoluble Boundary Value Problems
- An algorithm for maximizing expected log investment return
- Compound decision theory and empirical Bayes methods
- Consistency of the Maximum Likelihood Estimator in the Presence of Infinitely Many Incidental Parameters
- Empirical Bayes on vector observations: An extension of Stein's method
- Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities.
- Estimation with quadratic loss.
- Gaussian model selection
- General empirical Bayes wavelet methods and exactly adaptive minimax estimation
- Generalized maximum likelihood estimation of normal mixture densities
- scientific article; zbMATH DE number 3122730 (Why is no real title available?)
- scientific article; zbMATH DE number 3124366 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 472960 (Why is no real title available?)
- scientific article; zbMATH DE number 524360 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 1057577 (Why is no real title available?)
- scientific article; zbMATH DE number 1850478 (Why is no real title available?)
- scientific article; zbMATH DE number 3068128 (Why is no real title available?)
- Ideal spatial adaptation by wavelet shrinkage
- Incorporating information on neighbouring coefficients into wavelet estimation
- Minimax multiple shrinkage estimation
- Minimax risk over \(l_ p\)-balls for \(l_ q\)-error
- Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
- Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
- Parametric Empirical Bayes Inference: Theory and Applications
- Posterior convergence rates of Dirichlet mixtures at smooth densities
- Robbins, empirical Bayes and microarrays
- Some thoughts on empirical Bayes estimation
- Stein's Estimation Rule and Its Competitors--An Empirical Bayes Approach
- The Empirical Bayes Approach to Statistical Decision Problems
- The risk inflation criterion for multiple regression
- Weak convergence and empirical processes. With applications to statistics
Cited in
(94)- A deconvolution path for mixtures
- Simultaneous estimation based on empirical likelihood and general maximum likelihood estimation
- Approximate nonparametric maximum likelihood for mixture models: a convex optimization approach to fitting arbitrary multivariate mixing distributions
- Empirical Bayes analysis of spike and slab posterior distributions
- On regularized general empirical Bayes estimation of normal means
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- Empirical Bayes scaling of Gaussian priors in the white noise model
- A survey of nonparametric mixing density estimation via the predictive recursion algorithm
- High-dimensional linear discriminant analysis using nonparametric methods
- A computationally efficient approach to estimating species richness and rarefaction curve
- Generalized maximum likelihood estimation of the mean of parameters of mixtures. With applications to sampling and to observational studies
- Minimax bounds for estimating multivariate Gaussian location mixtures
- Poisson mean vector estimation with nonparametric maximum likelihood estimation and application to protein domain data
- On general maximum likelihood empirical Bayes estimation of heteroscedastic IID normal means
- Statistical theory powering data science
- On the nonparametric maximum likelihood estimator for Gaussian location mixture densities with application to Gaussian denoising
- Empirical priors and coverage of posterior credible sets in a sparse normal mean model
- On spike and slab empirical Bayes multiple testing
- Spike and slab empirical Bayes sparse credible sets
- Generalized Bayesian shrinkage and wavelet estimation of location parameter for spherical distribution under balance-type loss: minimaxity and admissibility
- Rate of divergence of the nonparametric likelihood ratio test for Gaussian mixtures
- Nonparametric empirical Bayes improvement of shrinkage estimators with applications to time series
- Bayes, oracle Bayes and empirical Bayes
- Comment: Minimalist \(g\)-modeling
- Comment: ``Bayes, oracle Bayes and empirical Bayes
- Comment: Empirical Bayes interval estimation
- Comment: Empirical Bayes, compound decisions and exchangeability
- Comment: Variational autoencoders as empirical Bayes
- Rejoinder: ``Bayes, oracle Bayes, and empirical Bayes
- Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
- Estimating the mean and variance of a high-dimensional normal distribution using a mixture prior
- A guided random walk through some high dimensional problems
- Two modeling strategies for empirical Bayes estimation
- Optimal shrinkage estimation of mean parameters in family of distributions with quadratic variance
- Deconvolution for an atomic distribution: rates of convergence
- A nonparametric empirical Bayes approach to adaptive minimax estimation
- Adaptive nonparametric empirical Bayes estimation via wavelet series: the minimax study
- scientific article; zbMATH DE number 1057577 (Why is no real title available?)
- TESTING FOR HOMOGENEITY IN MIXTURE MODELS
- Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
- The horseshoe estimator: posterior concentration around nearly black vectors
- SURE Estimates for a Heteroscedastic Hierarchical Model
- Group-linear empirical Bayes estimates for a heteroscedastic normal mean
- SURE estimates for high dimensional classification
- Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules
- Meta-analysis with fixed, unknown, study-specific parameters
- Optimal stopping and worker selection in crowdsourcing: an adaptive sequential probability ratio test framework
- A general framework for empirical Bayes estimation in discrete linear exponential family
- Efficient empirical Bayes estimates for risk parameters of Pareto distributions
- Simultaneous estimation of normal means with side information
- Asymptotically optimal nonparametric empirical Bayes via predictive recursion
- Integrative genetic risk prediction using non-parametric empirical Bayes classification
- The Poisson Compound Decision Problem Revisited
- Wavelet Shrinkage Generalized Bayes Estimation for Multivariate Normal Distribution Mean Vectors with unknown Covariance Matrix under Balanced-LINEX Loss
- An Empirical Bayes Method for Chi-Squared Data
- Irrational Exuberance: Correcting Bias in Probability Estimates
- Confidence Intervals for Nonparametric Empirical Bayes Analysis
- ebTobit
- Compound Sequential Change-point Detection in Parallel Data Streams
- A Compound Decision Approach to Covariance Matrix Estimation
- On a Problem of Robbins
- A Regression Modeling Approach to Structured Shrinkage Estimation
- Empirical Bayes Mean Estimation With Nonparametric Errors Via Order Statistic Regression on Replicated Data
- Robust empirical Bayes confidence intervals
- A Gaussian compound decision bakeoff
- Consistency of the generalized likelihood ratio test for heteroscedastic normal mixtures
- High dimensional discriminant rules with shrinkage estimators of the covariance matrix and mean vector
- Unobserved Heterogeneity in Income Dynamics: An Empirical Bayes Perspective
- Nonparametric empirical Bayes biomarker imputation and estimation
- Learning Gaussian mixtures using the Wasserstein-Fisher-Rao gradient flow
- Two-sample test with \(g\)-modeling and its applications
- No need for an oracle: the nonparametric maximum likelihood decision in the compound decision problem is minimax
- Empirical priors and posterior concentration in a piecewise polynomial sequence model
- Poisson empirical Bayes estimation: when does g-modeling beat f-modeling in theory (and in practice)?
- Optimal empirical Bayes estimation for the Poisson model via minimum-distance methods
- Location parameter estimation for elliptical distribution under the balanced-LINEX loss
- Asymptotic mutual information in quadratic estimation problems over compact groups
- Multivariate, heteroscedastic empirical Bayes via nonparametric maximum likelihood
- Posterior contraction rate and asymptotic Bayes optimality for one group global-local shrinkage priors in sparse normal means problem
- Stein estimator from a polar coordinate perspective
- Nonparametric empirical Bayes prediction in mixed models
- Empirical Bayes Estimation via Data Fission
- A new perspective on denoising based on optimal transport
- Empirical partially Bayes multiple testing and compound ^2 decisions
- Sparse recovery with multiple data streams: an adaptive sequential testing approach
- A frequentist local false discovery rate
- Empirical Bayes when estimation precision predicts parameters
- Optimal shrinkage estimation of fixed effects in linear panel data models
- Approximate independence of permutation mixtures
- Regularity and propagation of chaos for conditional McKean-Vlasov equations
- A Bayesian bootstrap for mixture models
- A nonparametric empirical Bayes approach to large-scale multivariate regression
- On the normalized maximum likelihood and Bayesian decision theory
- A Fast Algorithm for Maximum Likelihood Estimation of Mixture Proportions Using Sequential Quadratic Programming
This page was built for publication: General maximum likelihood empirical Bayes estimation of normal means
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2388976)
