High-dimensional Bayesian inference in nonparametric additive models
From MaRDI portal
Abstract: A fully Bayesian approach is proposed for ultrahigh-dimensional nonparametric additive models in which the number of additive components may be larger than the sample size, though ideally the true model is believed to include only a small number of components. Bayesian approaches can conduct stochastic model search and fulfill flexible parameter estimation by stochastic draws. The theory shows that the proposed model selection method has satisfactory properties. For instance, when the hyperparameter associated with the model prior is correctly specified, the true model has posterior probability approaching one as the sample size goes to infinity; when this hyperparameter is incorrectly specified, the selected model is still acceptable since asymptotically it is proved to be nested in the true model. To enhance model flexibility, two new -priors are proposed and their theoretical performance is examined. We also propose an efficient MCMC algorithm to handle the computational issues. Several simulation examples are provided to demonstrate the computational advantages of our method.
Recommendations
- Fast Bayesian model assessment for nonparametric additive regression
- Bayesian high-dimensional screening via MCMC
- Semiparametric Bayesian information criterion for model selection in ultra-high dimensional additive models
- Bayesian identification, selection and estimation of semiparametric functions in high-dimensional additive models
- Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 4213315 (Why is no real title available?)
- scientific article; zbMATH DE number 3716572 (Why is no real title available?)
- scientific article; zbMATH DE number 47282 (Why is no real title available?)
- scientific article; zbMATH DE number 1941665 (Why is no real title available?)
- scientific article; zbMATH DE number 1433619 (Why is no real title available?)
- scientific article; zbMATH DE number 3081828 (Why is no real title available?)
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- A cocktail algorithm for solving the elastic net penalized Cox's regression in high dimensions
- A tail inequality for quadratic forms of subgaussian random vectors
- A unified approach to model selection and sparse recovery using regularized least squares
- Adaptive Bayesian inference on the mean of an infinite-dimensional normal distribution
- Additive regression and other nonparametric models
- Approximations and consistency of Bayes factors as model dimension grows
- Asymptotic properties of bridge estimators in sparse high-dimensional regression models
- BART: Bayesian additive regression trees
- Bayesian Subset Modeling for High-Dimensional Generalized Linear Models
- Bayesian Variable Selection and Regularization for Time–Frequency Surface Estimation
- Bayesian data analysis.
- Bayesian high-dimensional screening via MCMC
- Bayesian model selection in high-dimensional settings
- Bayesian variable selection for high dimensional generalized linear models: convergence rates of the fitted densities
- Benchmark priors for Bayesian model averaging.
- Component selection and smoothing in multivariate nonparametric regression
- Consistency of Bayesian linear model selection with a growing number of parameters
- Consistency of Bayesian procedures for variable selection
- Consistency of objective Bayes factors for nonnested linear models and increasing model dimension
- Fast Bayesian model assessment for nonparametric additive regression
- Gibbs posterior for variable selection in high-dimensional classification and data mining
- High-dimensional additive modeling
- High-dimensional generalized linear models and the lasso
- High-dimensional graphs and variable selection with the Lasso
- Lasso-type recovery of sparse representations for high-dimensional data
- Likelihood-based selection and sharp parameter estimation
- Mixtures of g Priors for Bayesian Variable Selection
- Multiple shrinkage and subset selection in wavelets
- Nonparametric independence screening in sparse ultra-high-dimensional additive models
- Optimal predictive model selection.
- Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ 1 minimization
- Regularized rank-based estimation of high-dimensional nonparanormal graphical models
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
- Spike-and-slab priors for function selection in structured additive regression models
- Sure independence screening and compressed random sensing
- Sure independence screening in generalized linear models with NP-dimensionality
- The Intrinsic Bayes Factor for Model Selection and Prediction
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
- Variable selection in nonparametric additive models
Cited in
(12)- Semiparametric Bayesian information criterion for model selection in ultra-high dimensional additive models
- Statistical inference in sparse high-dimensional additive models
- Bayesian additive adaptive basis tensor product models for modeling high dimensional surfaces: an application to high‐throughput toxicity testing
- Bayesian identification, selection and estimation of semiparametric functions in high-dimensional additive models
- On some recent advances on high dimensional Bayesian statistics
- On numerical aspects of Bayesian model selection in high and ultrahigh-dimensional settings
- Uncertainty Quantification for High-Dimensional Sparse Nonparametric Additive Models
- Inference of gene regulatory networks using Bayesian nonparametric regression and topology information
- Ultrahigh‐dimensional generalized additive model: Unified theory and methods
- A nonparametric Bayesian technique for high-dimensional regression
- Fast Bayesian model assessment for nonparametric additive regression
- Consistent group selection with Bayesian high dimensional modeling
This page was built for publication: High-dimensional Bayesian inference in nonparametric additive models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q485930)
