Unified Bayesian theory of sparse linear regression with nuisance parameters
From MaRDI portal
Abstract: We study frequentist asymptotic properties of Bayesian procedures for high-dimensional Gaussian sparse regression when unknown nuisance parameters are involved. Nuisance parameters can be finite-, high-, or infinite-dimensional. A mixture of point masses at zero and continuous distributions is used for the prior distribution on sparse regression coefficients, and appropriate prior distributions are used for nuisance parameters. The optimal posterior contraction of sparse regression coefficients, hampered by the presence of nuisance parameters, is also examined and discussed. It is shown that the procedure yields strong model selection consistency. A Bernstein-von Mises-type theorem for sparse regression coefficients is also obtained for uncertainty quantification through credible sets with guaranteed frequentist coverage. Asymptotic properties of numerous examples are investigated using the theories developed in this study.
Recommendations
- Bayesian linear regression with sparse priors
- Bayesian sparse linear regression with unknown symmetric error
- Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
- Finite sample posterior concentration in high-dimensional regression
- Bayesian linear regression for multivariate responses under group sparsity
Cites work
- A general framework for Bayes structured linear models
- A practical guide to splines
- A semiparametric Bernstein-von Mises theorem for Gaussian process priors
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- Bayesian linear regression for multivariate responses under group sparsity
- Bayesian linear regression with sparse priors
- Bayesian model selection in high-dimensional settings
- Bayesian sparse linear regression with unknown symmetric error
- Bayesian variable selection with shrinking and diffusing priors
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Convergence rates of posterior distributions for non iid observations
- Convergence rates of posterior distributions.
- Eigenvalues of tridiagonal pseudo-Toeplitz matrices
- Empirical Bayes oracle uncertainty quantification for regression
- Empirical Bayes posterior concentration in sparse high-dimensional linear models
- Fundamentals of nonparametric Bayesian inference
- scientific article; zbMATH DE number 52749 (Why is no real title available?)
- Measurement Error in Nonlinear Models
- Needles and straw in a haystack: posterior concentration for possibly sparse sequences
- On the contraction properties of some high-dimensional quasi-posterior distributions
- Posterior contraction in sparse generalized linear models
- Sparse permutation invariant covariance estimation
- Spectral properties of Kac-Murdock-Szegö matrices with a complex parameter
- The moments of products of quadratic forms in normal variables
- The semiparametric Bernstein-von Mises theorem
- Weak convergence and empirical processes. With applications to statistics
Cited in
(13)- Posterior contraction in group sparse logit models for categorical responses
- Bayesian estimation of sparse precision matrices in the presence of Gaussian measurement error
- Sparse Bayesian linear regression using generalized normal priors
- Bayesian sparse seemingly unrelated regressions model with variable selection and covariance estimation via the horseshoe+
- Bayesian Multi-Task Variable Selection with an Application to Differential DAG Analysis
- Hierarchical shrinkage Gaussian processes: applications to computer code emulation and dynamical system recovery
- Adaptive posterior concentration rates for sparse high-dimensional linear regression with random design and unknown error variance
- L₂-norm posterior contraction in Gaussian models with unknown variance
- Posterior contraction rates in a sparse non-linear mixed-effects model
- Posterior contraction and uncertainty quantification for the multivariate spike-and-slab LASSO
- Sparse high-dimensional linear mixed modeling with a partitioned empirical Bayes ECM algorithm
- Bayesian inference in high-dimensional models
- Bayesian linear regression with sparse priors
This page was built for publication: Unified Bayesian theory of sparse linear regression with nuisance parameters
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2044407)
