Bayesian shrinkage prediction for the regression problem
From MaRDI portal
Publication:953850
Abstract: We consider Bayesian shrinkage predictions for the Normal regression problem under the frequentist Kullback-Leibler risk function. Firstly, we consider the multivariate Normal model with an unknown mean and a known covariance. While the unknown mean is fixed, the covariance of future samples can be different from training samples. We show that the Bayesian predictive distribution based on the uniform prior is dominated by that based on a class of priors if the prior distributions for the covariance and future covariance matrices are rotation invariant. Then, we consider a class of priors for the mean parameters depending on the future covariance matrix. With such a prior, we can construct a Bayesian predictive distribution dominating that based on the uniform prior. Lastly, applying this result to the prediction of response variables in the Normal linear regression model, we show that there exists a Bayesian predictive distribution dominating that based on the uniform prior. Minimaxity of these Bayesian predictions follows from these results.
Recommendations
- Shrinkage priors for Bayesian prediction
- A shrinkage predictive distribution for multivariate normal observables
- Bayesian prediction based on a class of shrinkage priors for location-scale models
- Improved prediction for a multivariate normal distribution with unknown mean and variance
- Singular value shrinkage priors for Bayesian prediction
Cites work
- scientific article; zbMATH DE number 1631958 (Why is no real title available?)
- scientific article; zbMATH DE number 1220667 (Why is no real title available?)
- scientific article; zbMATH DE number 3300124 (Why is no real title available?)
- A Note on the Estimation of Probability Density Functions
- A shrinkage predictive distribution for multivariate normal observables
- Applications of Differential Geometry to Econometrics
- Exact Minimax Strategies for Predictive Density Estimation, Data Compression, and Model Selection
- Improved minimax predictive densities under Kullback-Leibler loss
- On asymptotic properties of predictive distributions
- On the estimation of parametric density functions
- PREDICTIVE DENSITY ESTIMATION FOR MULTIPLE REGRESSION
- Shrinkage priors for Bayesian prediction
- The elements of statistical learning. Data mining, inference, and prediction
Cited in
(19)- Highest predictive density estimator in regression models
- Asymptotic properties of Bayesian predictive densities when the distributions of data and target variables are different
- Minimax predictive density for sparse count data
- Using the Bayesian Shtarkov solution for predictions
- On minimax optimality of sparse Bayes predictive density estimates
- scientific article; zbMATH DE number 4001207 (Why is no real title available?)
- Inadmissibility of the corrected Akaike information criterion
- Random projections for Bayesian regression
- Singular value shrinkage priors for Bayesian prediction
- scientific article; zbMATH DE number 221913 (Why is no real title available?)
- Simultaneous prediction for independent Poisson processes with different durations
- Bayesian prediction based on a class of shrinkage priors for location-scale models
- Bayesian prediction and estimation based on a shrinkage prior for a Poisson regression model
- Prediction risk for the horseshoe regression
- scientific article; zbMATH DE number 7750677 (Why is no real title available?)
- A shrinkage predictive distribution for multivariate normal observables
- Predictive densities for multivariate normal models based on extended models and shrinkage Bayes methods
- From minimax shrinkage estimation to minimax shrinkage prediction
- Shrinkage priors for Bayesian prediction
This page was built for publication: Bayesian shrinkage prediction for the regression problem
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q953850)
