Needles and straw in a haystack: posterior concentration for possibly sparse sequences

DOI10.1214/12-AOS1029zbMath1257.62025arXiv1211.1197OpenAlexW2147426468MaRDI QIDQ1940767

Ismaël Castillo, Aad W. van der Vaart

Publication date: 7 March 2013

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1211.1197

zbMATH Keywords

asymptoticscontractionssparsitymixture priorsGaussian sequence modelBayesian estimators

Mathematics Subject Classification ID

Related Items (79)

On minimax optimality of sparse Bayes predictive density estimates ⋮ Posterior contraction rate of sparse latent feature models with application to proteomics ⋮ Modeling association between multivariate correlated outcomes and high-dimensional sparse covariates: the adaptive SVS method ⋮ Bayesian variable selection and estimation for group Lasso ⋮ Bayesian Edge Regression in Undirected Graphical Models to Characterize Interpatient Heterogeneity in Cancer ⋮ Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior ⋮ Conditions for posterior contraction in the sparse normal means problem ⋮ Bayesian variable selection in quantile regression with random effects: an application to Municipal Human Development Index ⋮ Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors ⋮ Prior distributions for objective Bayesian analysis ⋮ Sub-optimality of some continuous shrinkage priors ⋮ Contraction of a quasi-Bayesian model with shrinkage priors in precision matrix estimation ⋮ The Spike-and-Slab LASSO ⋮ Adaptive rates of contraction of posterior distributions in Bayesian wavelet regression ⋮ Bayesian linear regression with sparse priors ⋮ Bayesian Approaches to Shrinkage and Sparse Estimation ⋮ Projective inference in high-dimensional problems: prediction and feature selection ⋮ Horseshoe Regularisation for Machine Learning in Complex and Deep Models¹ ⋮ Optimal false discovery control of minimax estimators ⋮ Bayesian shrinkage towards sharp minimaxity ⋮ A Regression Modeling Approach to Structured Shrinkage Estimation ⋮ Neuronized Priors for Bayesian Sparse Linear Regression ⋮ Bayesian tensor response regression with an application to brain activation studies ⋮ Nearly optimal Bayesian shrinkage for high-dimensional regression ⋮ Bayesian sparse spiked covariance model with a continuous matrix shrinkage prior ⋮ Global-local shrinkage priors for asymptotic point and interval estimation of normal means under sparsity ⋮ Objective Bayesian model discrimination in follow-up experimental designs ⋮ Needles and straw in a haystack: posterior concentration for possibly sparse sequences ⋮ Nonparametric Bayesian analysis of the compound Poisson prior for support boundary recovery ⋮ Robust oracle estimation and uncertainty quantification for possibly sparse quantiles ⋮ A Mass-Shifting Phenomenon of Truncated Multivariate Normal Priors ⋮ Fast exact Bayesian inference for sparse signals in the normal sequence model ⋮ Posterior consistency of factor dimensionality in high-dimensional sparse factor models ⋮ High-dimensional Bayesian network classification with network global-local shrinkage priors ⋮ Semiparametric functional factor models with Bayesian rank selection ⋮ Optimal Bayesian estimation of Gaussian mixtures with growing number of components ⋮ Variational Bayes for High-Dimensional Linear Regression With Sparse Priors ⋮ Bayesian fusion estimation via \(t\) shrinkage ⋮ Posterior contraction rates for stochastic block models ⋮ Empirical priors and coverage of posterior credible sets in a sparse normal mean model ⋮ Empirical Bayes analysis of spike and slab posterior distributions ⋮ Posterior concentration for Bayesian regression trees and forests ⋮ On spike and slab empirical Bayes multiple testing ⋮ A general framework for Bayes structured linear models ⋮ Thomas Bayes' walk on manifolds ⋮ Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector ⋮ A novel variational Bayesian method for variable selection in logistic regression models ⋮ Learning from a lot: Empirical Bayes for high‐dimensional model‐based prediction ⋮ The horseshoe estimator: posterior concentration around nearly black vectors ⋮ Well-Posed Bayesian Inverse Problems with Infinitely Divisible and Heavy-Tailed Prior Measures ⋮ Spike-and-slab Lasso biclustering ⋮ Bayesian estimation of sparse precision matrices in the presence of Gaussian measurement error ⋮ Simultaneous estimation of normal means with side information ⋮ Bayesian estimation of sparse signals with a continuous spike-and-slab prior ⋮ Bayesian structure learning in graphical models ⋮ Spike and slab empirical Bayes sparse credible sets ⋮ Needles and straw in a haystack: robust confidence for possibly sparse sequences ⋮ Penalising model component complexity: a principled, practical approach to constructing priors ⋮ Posterior contraction in sparse Bayesian factor models for massive covariance matrices ⋮ Bayesian variance estimation in the Gaussian sequence model with partial information on the means ⋮ Adaptive Bayesian density regression for high-dimensional data ⋮ A nonparametric spatial test to identify factors that shape a microbiome ⋮ Lasso meets horseshoe: a survey ⋮ On the exponentially weighted aggregate with the Laplace prior ⋮ Oracle posterior contraction rates under hierarchical priors ⋮ Unified Bayesian theory of sparse linear regression with nuisance parameters ⋮ Adaptive Bayesian nonparametric regression using a kernel mixture of polynomials with application to partial linear models ⋮ Contraction properties of shrinkage priors in logistic regression ⋮ Bayesian effect selection in structured additive distributional regression models ⋮ Bayes Variable Selection in Semiparametric Linear Models ⋮ EMVS: The EM Approach to Bayesian Variable Selection ⋮ Gibbs posterior inference on multivariate quantiles ⋮ Posterior analysis of \(n\) in the binomial \((n,p)\) problem with both parameters unknown -- with applications to quantitative nanoscopy ⋮ Comment: ``Bayes, oracle Bayes and empirical Bayes ⋮ Skinny Gibbs: A Consistent and Scalable Gibbs Sampler for Model Selection ⋮ Data-driven priors and their posterior concentration rates ⋮ Rates of contraction with respect to \(L_2\)-distance for Bayesian nonparametric regression ⋮ Rate-optimal posterior contraction for sparse PCA ⋮ Local Posterior Concentration Rate for Multilevel Sparse Sequences

Uses Software

• EBayesThresh

Cites Work

• Unnamed Item
• Unnamed Item
• The Adaptive Lasso and Its Oracle Properties
• Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
• The sparsity and bias of the LASSO selection in high-dimensional linear regression
• Minimax risk over \(l_ p\)-balls for \(l_ q\)-error
• General empirical Bayes wavelet methods and exactly adaptive minimax estimation
• Reconstruction of sparse vectors in white Gaussian noise
• Needles and straw in haystacks: Empirical Bayes estimates of possibly sparse sequences
• Needles and straw in a haystack: posterior concentration for possibly sparse sequences
• Lower bounds for posterior rates with Gaussian process priors
• General maximum likelihood empirical Bayes estimation of normal means
• Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
• Simultaneous analysis of Lasso and Dantzig selector
• On optimality of Bayesian testimation in the normal means problem
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• Estimation and confidence sets for sparse normal mixtures
• Adapting to unknown sparsity by controlling the false discovery rate
• Empirical Bayes selection of wavelet thresholds
• Calibration and empirical Bayes variable selection
• Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
• Gaussian model selection

This page was built for publication: Needles and straw in a haystack: posterior concentration for possibly sparse sequences