Asymptotic behaviour of the empirical Bayes posteriors associated to maximum marginal likelihood estimator

DOI10.1214/16-AOS1469zbMATH Open1371.62048arXiv1504.04814MaRDI QIDQ2012208FDOQ2012208

Authors: Judith Rousseau, Botond Szabó 

Publication date: 28 July 2017

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: We consider the asymptotic behaviour of the marginal maximum likelihood empirical Bayes posterior distribution in general setting. First we characterize the set where the maximum marginal likelihood estimator is located with high probability. Then we provide oracle type of upper and lower bounds for the contraction rates of the empirical Bayes posterior. We also show that the hierarchical Bayes posterior achieves the same contraction rate as the maximum marginal likelihood empirical Bayes posterior. We demonstrate the applicability of our general results for various models and prior distributions by deriving upper and lower bounds for the contraction rates of the corresponding empirical and hierarchical Bayes posterior distributions.

Full work available at URL: https://arxiv.org/abs/1504.04814

Recommendations

• Posterior concentration rates for empirical Bayes procedures with applications to Dirichlet process mixtures
• On asymptotic optimality of bayes empirical bayes estimators
• Bayes and empirical Bayes: do they merge?
• scientific article; zbMATH DE number 1157188
• Empirical Bayes posterior concentration in sparse high-dimensional linear models

zbMATH Keywords

density estimationnonparametric regressionadaptationempirical BayesGaussian priorhierarchical Bayesmaximum marginal likelihood estimatorposterior contraction ratestruncation prior

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Density estimation (62G07) Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20)

Cited In (20)

• Optimal convergence rates of Bayesian wavelet estimation with a novel empirical prior in nonparametric regression model
• Needles and straw in a haystack: robust confidence for possibly sparse sequences
• Convergence rates of variational posterior distributions
• Adaptive inference over Besov spaces in the white noise model using \(p\)-exponential priors
• An approximate empirical Bayesian method for large-scale linear-Gaussian inverse problems
• Learning from a lot: empirical Bayes for high-dimensional model-based prediction
• Asymptotic frequentist coverage properties of Bayesian credible sets for sieve priors
• Asymptotic Bounds for Smoothness Parameter Estimates in Gaussian Process Interpolation
• Oracle posterior contraction rates under hierarchical priors
• Can we trust Bayesian uncertainty quantification from Gaussian process priors with squared exponential covariance kernel?
• Adaptive variational Bayes: optimality, computation and applications
• Ideal Bayesian Spatial Adaptation
• On the beta prime prior for scale parameters in high-dimensional Bayesian regression models
• Posterior consistency of factor dimensionality in high-dimensional sparse factor models
• Maximum likelihood estimation of regularization parameters in high-dimensional inverse problems: an empirical Bayesian approach. I: Methodology and experiments
• Empirical priors and posterior concentration rates for a monotone density
• A fast and calibrated computer model emulator: an empirical Bayes approach
• A note on the asymptotic behaviour of empirical likelihood statistics
• Rates of contraction of posterior distributions based on \(p\)-exponential priors
• Data-driven priors and their posterior concentration rates

This page was built for publication: Asymptotic behaviour of the empirical Bayes posteriors associated to maximum marginal likelihood estimator

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2012208)