Adaptive Bayesian estimation using a Gaussian random field with inverse gamma bandwidth
From MaRDI portal
(Redirected from Publication:834358)
Abstract: We consider nonparametric Bayesian estimation inference using a rescaled smooth Gaussian field as a prior for a multidimensional function. The rescaling is achieved using a Gamma variable and the procedure can be viewed as choosing an inverse Gamma bandwidth. The procedure is studied from a frequentist perspective in three statistical settings involving replicated observations (density estimation, regression and classification). We prove that the resulting posterior distribution shrinks to the distribution that generates the data at a speed which is minimax-optimal up to a logarithmic factor, whatever the regularity level of the data-generating distribution. Thus the hierachical Bayesian procedure, with a fixed prior, is shown to be fully adaptive.
Recommendations
- Adaptive nonparametric Bayesian inference using location-scale mixture priors
- Bayesian adaptation
- Adaptive Bayesian estimation in Gaussian sequence space models
- Adaptive Bayesian procedures using random series priors
- Adaptive Bayesian density estimation in \(L^p\)-metrics with Pitman-Yor or normalized inverse-Gaussian process kernel mixtures
Cites work
- scientific article; zbMATH DE number 4011245 (Why is no real title available?)
- scientific article; zbMATH DE number 3731021 (Why is no real title available?)
- scientific article; zbMATH DE number 3780407 (Why is no real title available?)
- scientific article; zbMATH DE number 194093 (Why is no real title available?)
- scientific article; zbMATH DE number 3619167 (Why is no real title available?)
- scientific article; zbMATH DE number 3633568 (Why is no real title available?)
- scientific article; zbMATH DE number 739533 (Why is no real title available?)
- scientific article; zbMATH DE number 4197203 (Why is no real title available?)
- scientific article; zbMATH DE number 3215519 (Why is no real title available?)
- scientific article; zbMATH DE number 3329342 (Why is no real title available?)
- A Correspondence Between Bayesian Estimation on Stochastic Processes and Smoothing by Splines
- Adaptive asymptotically minimax estimators of smooth signals
- Adaptive minimax estimation of infinitely differentiable functions.
- Adaptive wavelet estimation: A block thresholding and oracle inequality approach
- Alternative posterior consistency results in nonparametric binary regression using Gaussian process priors
- An asymptotically optimal window selection rule for kernel density estimates
- Analytic Extensions of Differentiable Functions Defined in Closed Sets
- Approximation, metric entropy and small ball estimates for Gaussian measures
- Asymptotically Minimax Adaptive Estimation. I: Upper Bounds. Optimally Adaptive Estimates
- Asymptotically efficient estimation for analytic distributions
- Asymptotically local minimax estimation of infinitely smooth density with censored data
- Asymptotically minimax adaptive estimation. II: Schemes without optimal adaption. Adaptive estimates
- Bayesian inference with rescaled Gaussian process priors
- Convergence rates for posterior distributions and adaptive estimation
- Convergence rates of posterior distributions.
- Density estimation by wavelet thresholding
- Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities.
- Gaussian processes for machine learning.
- Introduction to probability and measure
- Learning algorithm for nonparametric filtering
- Metric entropy and the small ball problem for Gaussian measures
- Minimum complexity density estimation
- Nonparametric Bayesian model selection and averaging
- Nonparametric binary regression using a Gaussian process prior
- Nonparametric curve estimation. Methods, theory, and applications
- On posterior consistency in nonparametric regression problems
- On universal Bayesian adaptation
- Posterior consistency of Gaussian process prior for nonparametric binary regression
- Posterior consistency of logistic Gaussian process priors in density estimation
- Posterior convergence rates of Dirichlet mixtures at smooth densities
- Rates of contraction of posterior distributions based on Gaussian process priors
- Risk bounds for model selection via penalization
- Spline smoothing in regression models and asymptotic efficiency in \(L_ 2\)
- The Gaussian measure of shifted balls
- The Logistic Normal Distribution for Bayesian, Nonparametric, Predictive Densities
- Towards a practicable Bayesian nonparametric density estimator
- Weak convergence and empirical processes. With applications to statistics
Cited in
(81)- Adaptive rates of contraction of posterior distributions in Bayesian wavelet regression
- Adaptive Bayesian nonparametric regression using a kernel mixture of polynomials with application to partial linear models
- Bayesian inverse problems with non-conjugate priors
- Posterior contraction in Gaussian process regression using Wasserstein approximations
- Bayesian fractional posteriors
- Extrinsic Gaussian processes for regression and classification on manifolds
- Bayes procedures for adaptive inference in inverse problems for the white noise model
- On posterior distribution of Bayesian wavelet thresholding
- Rates of contraction with respect to \(L_2\)-distance for Bayesian nonparametric regression
- Bayesian closed surface fitting through tensor products
- On some aspects of the asymptotic properties of Bayesian approaches in nonparametric and semiparametric models
- Nonparametric Bayesian inference for ergodic diffusions
- A closer look at covering number bounds for Gaussian kernels
- Adaptive nonparametric Bayesian inference using location-scale mixture priors
- Constructing Priors that Penalize the Complexity of Gaussian Random Fields
- Heavy-Tailed Density Estimation
- A Bayesian approach for consistent reconstruction of inclusions
- Bayesian nonparametric regression with varying residual density
- Bayesian manifold regression
- Consistency of posterior distributions for heteroscedastic nonparametric regression models
- Rates of convergence for the posterior distributions of mixtures of betas and adaptive nonparametric estimation of the density
- Rates of contraction for posterior distributions in \(L^{r}\)-metrics, \(1 \leq r \leq \infty\)
- Anisotropic function estimation using multi-bandwidth Gaussian processes
- Consistency of Bayesian inference with Gaussian process priors in an elliptic inverse problem
- On adaptive posterior concentration rates
- Minimax-optimal nonparametric regression in high dimensions
- Rate exact Bayesian adaptation with modified block priors
- Comparing and Weighting Imperfect Models Using D-Probabilities
- Adaptive Bayesian estimation in Gaussian sequence space models
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- Adaptive Bayesian estimation of conditional densities
- Recovering gradients from sparsely observed functional data
- Adaptive method for indirect identification of the statistical properties of random fields in a Bayesian framework
- Oracle posterior contraction rates under hierarchical priors
- Empirical Bayes scaling of Gaussian priors in the white noise model
- Adaptive Bayesian density estimation in \(L^p\)-metrics with Pitman-Yor or normalized inverse-Gaussian process kernel mixtures
- Posterior convergence for Bayesian functional linear regression
- Asymptotic Bounds for Smoothness Parameter Estimates in Gaussian Process Interpolation
- A geometric variational approach to Bayesian inference
- Can we trust Bayesian uncertainty quantification from Gaussian process priors with squared exponential covariance kernel?
- Bayesian fixed-domain asymptotics for covariance parameters in a Gaussian process model
- Rates for Bayesian estimation of location-scale mixtures of super-smooth densities
- Wasserstein convergence in Bayesian and frequentist deconvolution models
- Heavy-tailed Bayesian nonparametric adaptation
- Adaptive estimation of stationary Gaussian fields
- Lower bound for the oracle projection posterior convergence rate
- Adaptive Bayesian inference in the Gaussian sequence model using exponential-variance priors
- Adaptive Bayesian credible sets in regression with a Gaussian process prior
- Bayesian adaptation
- Comparison theorems on large-margin learning
- Semiparametric Bayesian causal inference
- Variable selection consistency of Gaussian process regression
- Flexible Bayesian dynamic modeling of correlation and covariance matrices
- Adaptive Bayesian procedures using random series priors
- Spike and slab Pólya tree posterior densities: adaptive inference
- Bayesian optimal adaptive estimation using a sieve prior
- Adaptive estimation of multivariate functions using conditionally Gaussian tensor-product spline priors
- Semiparametric Bernstein-von Mises for the error standard deviation
- Posterior contraction rates of density derivative estimation
- Consistent online Gaussian process regression without the sample complexity bottleneck
- A note on the smoothness of densities
- The Bayesian approach to inverse Robin problems
- Thomas Bayes' walk on manifolds
- Posterior consistency in conditional distribution estimation
- Rates of contraction of posterior distributions based on \(p\)-exponential priors
- Discussion of ``Frequentist coverage of adaptive nonparametric Bayesian credible sets
- Laplace approximation for logistic Gaussian process density estimation and regression
- Adaptive learning rates for support vector machines working on data with low intrinsic dimension
- Full adaptation to smoothness using randomly truncated series priors with Gaussian coefficients and inverse gamma scaling
- Bayesian Projected Calibration of Computer Models
- Hierarchical Bayesian level set inversion
- Gaussian processes for history-matching: application to an unconventional gas reservoir
- Nonparametric Bernstein-von Mises theorems in Gaussian white noise
- Learning rates for kernel-based expectile regression
- Optimal learning with Gaussians and correntropy loss
- Regularizing priors for linear inverse problems
- Bayesian estimation of nonlinear Hawkes processes
- A nonparametric Bayesian methodology for regression discontinuity designs
- A theoretical framework of the scaled Gaussian stochastic process in prediction and calibration
- Bayesian regression with nonparametric heteroskedasticity
- Data-driven priors and their posterior concentration rates
This page was built for publication: Adaptive Bayesian estimation using a Gaussian random field with inverse gamma bandwidth
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q834358)
