From robust tests to Bayes-like posterior distributions
From MaRDI portal
(Redirected from Publication:6145688)
Abstract: In the Bayes paradigm and for a given loss function, we propose the construction of a new type of posterior distributions, that extends the classical Bayes one, for estimating the law of an -sample. The loss functions we have in mind are based on the total variation and Hellinger distances as well as some -ones. We prove that, with a probability close to one, this new posterior distribution concentrates its mass in a neighbourhood of the law of the data, for the chosen loss function, provided that this law belongs to the support of the prior or, at least, lies close enough to it. We therefore establish that the new posterior distribution enjoys some robustness properties with respect to a possible misspecification of the prior, or more precisely, its support. For the total variation and squared Hellinger losses, we also show that the posterior distribution keeps its concentration properties when the data are only independent, hence not necessarily i.i.d., provided that most of their marginals or the average of these are close enough to some probability distribution around which the prior puts enough mass. The posterior distribution is therefore also stable with respect to the equidistribution assumption. We illustrate these results by several applications. We consider the problems of estimating a location parameter or both the location and the scale of a density in a nonparametric framework. Finally, we also tackle the problem of estimating a density, with the squared Hellinger loss, in a high-dimensional parametric model under some sparsity conditions. The results established in this paper are non-asymptotic and provide, as much as possible, explicit constants.
Cites work
- A General Framework for Updating Belief Distributions
- A new method for estimation and model selection: \(\rho\)-estimation
- About the non-asymptotic behaviour of Bayes estimators
- An alternative point of view on Lepski's method
- An MCMC approach to classical estimation.
- Approximation dans les espaces m�triques et th�orie de l'estimation
- Asymptotic Statistics
- Bayesian fractional posteriors
- Convergence of estimates under dimensionality restrictions
- Gibbs posterior for variable selection in high-dimensional classification and data mining
- scientific article; zbMATH DE number 3733065 (Why is no real title available?)
- scientific article; zbMATH DE number 949396 (Why is no real title available?)
- Minimum contrast estimators on sieves: Exponential bounds and rates of convergence
- Model selection via testing: an alternative to (penalized) maximum likelihood estimators.
- On the contraction properties of some high-dimensional quasi-posterior distributions
- PAC-Bayesian bounds for randomized empirical risk minimizers
- PIECEWISE-POLYNOMIAL APPROXIMATIONS OF FUNCTIONS OF THE CLASSES $ W_{p}^{\alpha}$
- Rho-estimators revisited: general theory and applications
- Robust Bayes-like estimation: rho-Bayes estimation
- Statistical learning theory and stochastic optimization. Ecole d'Eté de Probabilitiés de Saint-Flour XXXI -- 2001.
- Tests and estimation strategies associated to some loss functions
This page was built for publication: From robust tests to Bayes-like posterior distributions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6145688)
