Oracle posterior contraction rates under hierarchical priors
From MaRDI portal
Publication:2044331
DOI10.1214/21-EJS1811zbMATH Open1479.62029arXiv1704.07513MaRDI QIDQ2044331FDOQ2044331
Authors: Qiyang Han 
Publication date: 9 August 2021
Published in: Electronic Journal of Statistics (Search for Journal in Brave)
Abstract: We offer a general Bayes theoretic framework to derive posterior contraction rates under a hierarchical prior design: the first-step prior serves to assess the model selection uncertainty, and the second-step prior quantifies the prior belief on the strength of the signals within the model chosen from the first step. In particular, we establish non-asymptotic oracle posterior contraction rates under (i) a local Gaussianity condition on the log likelihood ratio of the statistical experiment, (ii) a local entropy condition on the dimensionality of the models, and (iii) a sufficient mass condition on the second-step prior near the best approximating signal for each model. The first-step prior can be designed generically. The posterior distribution enjoys Gaussian tail behavior and therefore the resulting posterior mean also satisfies an oracle inequality, automatically serving as an adaptive point estimator in a frequentist sense. Model mis-specification is allowed in these oracle rates. The local Gaussianity condition serves as a unified attempt of non-asymptotic Gaussian quantification of the experiments, and can be easily verified in various experiments considered in [GvdV07a] and beyond. The general results are applied in various problems including: (i) trace regression, (ii) shape-restricted isotonic/convex regression, (iii) high-dimensional partially linear regression, (iv) covariance matrix estimation in the sparse factor model, (v) detection of non-smooth polytopal image boundary, and (vi) intensity estimation in a Poisson point process model. These new results serve either as theoretical justification of practical prior proposals in the literature, or as an illustration of the generic construction scheme of a (nearly) minimax adaptive estimator for a complicated experiment.
Full work available at URL: https://arxiv.org/abs/1704.07513
Recommendations
- Rates of contraction of posterior distributions based on Gaussian process priors
- Oracle convergence rate of posterior under projection prior and Bayesian model selection
- Oracle-type posterior contraction rates in Bayesian inverse problems
- A general framework for Bayes structured linear models
- Adaptive posterior contraction rates for the horseshoe
covariance matrix estimationhierarchical priorsBayes nonparametricstrace regressiondetection of image boundaryintensity estimation of a Poisson point processlocal gaussianityshape-restricted regression
Nonparametric estimation (62G05) Asymptotic properties of nonparametric inference (62G20) Point processes (e.g., Poisson, Cox, Hawkes processes) (60G55) Estimation in multivariate analysis (62H12)
Cites Work
- Weak convergence and empirical processes. With applications to statistics
- Statistics for high-dimensional data. Methods, theory and applications.
- Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities.
- Title not available (Why is that?)
- Bayesian Estimation of the Spectral Density of a Time Series
- Title not available (Why is that?)
- Fundamentals of Nonparametric Bayesian Inference
- Adaptive Bayesian estimation using a Gaussian random field with inverse gamma bandwidth
- Convergence rates of posterior distributions for non iid observations
- Convergence rates of posterior distributions.
- Risk bounds for model selection via penalization
- A Bayesian approach for noisy matrix completion: optimal rate under general sampling distribution
- Posterior contraction in sparse Bayesian factor models for massive covariance matrices
- Bayesian monotone regression using Gaussian process projection
- Bayesian Isotonic Regression and Trend Analysis
- Decoding by Linear Programming
- Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization
- Minimax optimal rates of estimation in high dimensional additive models
- Tight Oracle Inequalities for Low-Rank Matrix Recovery From a Minimal Number of Noisy Random Measurements
- Estimation of high-dimensional low-rank matrices
- Misspecification in infinite-dimensional Bayesian statistics
- Title not available (Why is that?)
- On Bayesian supremum norm contraction rates
- Title not available (Why is that?)
- Minimum complexity density estimation
- A Bayesian approach to non-parametric monotone function estimation
- Asymptotic behaviour of the empirical Bayes posteriors associated to maximum marginal likelihood estimator
- Nonparametric Bayesian model selection and averaging
- Adaptive Bayesian inference on the mean of an infinite-dimensional normal distribution
- Rates of convergence of posterior distributions.
- Asymptotic equivalence for nonparametric regression with non-regular errors
- Adaptive Bayesian density estimation with location-scale mixtures
- Posterior concentration rates for empirical Bayes procedures with applications to Dirichlet process mixtures
- Bayesian optimal adaptive estimation using a sieve prior
- On universal Bayesian adaptation
- Adaptive nonparametric Bayesian inference using location-scale mixture priors
- Rates of contraction of posterior distributions based on Gaussian process priors
- Posterior convergence rates of Dirichlet mixtures at smooth densities
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- Bayesian linear regression with sparse priors
- On adaptive posterior concentration rates
- Rates of convergence for minimum contrast estimators
- Supremum norm posterior contraction and credible sets for nonparametric multivariate regression
- Approximation and estimation of \(s\)-concave densities via Rényi divergences
- Covering Numbers for Convex Functions
- Optimal rates of convergence for convex set estimation from support functions
- Information-theoretic determination of minimax rates of convergence
- Rate-optimal posterior contraction for sparse PCA
- On risk bounds in isotonic and other shape restricted regression problems
- Posterior convergence rates for estimating large precision matrices using graphical models
- Title not available (Why is that?)
- An asymptotic property of model selection criteria
- Bayesian nonparametric estimation of the spectral density of a long or intermediate memory Gaussian process
- Rates of convergence for the posterior distributions of mixtures of betas and adaptive nonparametric estimation of the density
- Asymptotic frequentist coverage properties of Bayesian credible sets for sieve priors
- Convergence rates for Bayesian density estimation of infinite-dimensional exponential families
- Bayesian structure learning in graphical models
- On coverage and local radial rates of credible sets
- Bayesian detection of image boundaries
- A Bayesian nonparametric approach to log-concave density estimation
- Minimax optimal estimation in partially linear additive models under high dimension
- Nonparametric Bayesian analysis of the compound Poisson prior for support boundary recovery
- A general framework for Bayes structured linear models
- Rates for Bayesian Estimation of Location-Scale Mixtures of Super-Smooth Densities
- Rate exact Bayesian adaptation with modified block priors
Cited In (3)
This page was built for publication: Oracle posterior contraction rates under hierarchical priors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2044331)
