Adaptive Bayesian estimation of conditional densities
From MaRDI portal
Abstract: We consider a non-parametric Bayesian model for conditional densities. The model is a finite mixture of normal distributions with covariate dependent multinomial logit mixing probabilities. A prior for the number of mixture components is specified on positive integers. The marginal distribution of covariates is not modeled. We study asymptotic frequentist behavior of the posterior in this model. Specifically, we show that when the true conditional density has a certain smoothness level, then the posterior contraction rate around the truth is equal up to a log factor to the frequentist minimax rate of estimation. An extension to the case when the covariate space is unbounded is also established. As our result holds without a priori knowledge of the smoothness level of the true density, the established posterior contraction rates are adaptive. Moreover, we show that the rate is not affected by inclusion of irrelevant covariates in the model. In Monte Carlo simulations, a version of the model compares favorably to a cross-validated kernel conditional density estimator.
Recommendations
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- Empirical Bayes conditional density estimation
- Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
- A consistent nonparametric Bayesian procedure for estimating autoregressive conditional den\-sities
- Nonparametric Bayesian model selection and averaging
Cites work
- Adaptive Bayesian density estimation with location-scale mixtures
- Adaptive Bayesian density regression for high-dimensional data
- Adaptive Bayesian estimation using a Gaussian random field with inverse gamma bandwidth
- Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
- Adaptive nonparametric Bayesian inference using location-scale mixture priors
- An ANOVA Model for Dependent Random Measures
- Anisotropic function estimation using multi-bandwidth Gaussian processes
- Approximation of conditional densities by smooth mixtures of regressions
- Bayesian Density Regression
- Bayesian density regression with logistic Gaussian process and subspace projection
- Bayesian Inference in Mixtures-of-Experts and Hierarchical Mixtures-of-Experts Models With an Application to Speech Recognition
- Bayesian mixture of splines for spatially adaptive nonparametric regression
- Bayesian modeling of joint and conditional distributions
- Conditional density estimation in a regression setting
- Convergence rates for Bayesian density estimation of infinite-dimensional exponential families
- Convergence rates for posterior distributions and adaptive estimation
- Convergence rates of posterior distributions.
- Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities.
- Flexible modeling of conditional distributions using smooth mixtures of asymmetric Student \(t\) densities
- Generalized smooth finite mixtures
- scientific article; zbMATH DE number 2135362 (Why is no real title available?)
- Improving prediction from Dirichlet process mixtures via enrichment
- Kernel stick-breaking processes
- Minimax-optimal nonparametric regression in high dimensions
- Nonparametric Bayes conditional distribution modeling with variable selection
- Nonparametric econometrics. Theory and practice.
- Order-Based Dependent Dirichlet Processes
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- Posterior consistency in conditional distribution estimation
- Posterior consistency of Dirichlet mixtures in density estimation
- Posterior convergence rates of Dirichlet mixtures at smooth densities
- Rates of convergence for the posterior distributions of mixtures of betas and adaptive nonparametric estimation of the density
- Regression density estimation using smooth adaptive Gaussian mixtures
- Smoothly mixing regressions
- The consistency of posterior distributions in nonparametric problems
Cited in
(26)- A consistent nonparametric Bayesian procedure for estimating autoregressive conditional den\-sities
- Bayesian nonparametric vector autoregressive models
- Adaptive-modal Bayesian nonparametric regression
- On adaptive Bayesian inference
- A review of uncertainty quantification for density estimation
- A non-asymptotic approach for model selection via penalization in high-dimensional mixture of experts models
- Adaptive Bayesian estimation of conditional discrete-continuous distributions with an application to stock market trading activity
- Adaptive method for indirect identification of the statistical properties of random fields in a Bayesian framework
- Contraction properties of shrinkage priors in logistic regression
- Bayesian adaptive estimation: the next dimension
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- Adaptive estimation of the conditional cumulative distribution function from current status data
- Empirical Bayes conditional density estimation
- Posterior asymptotics in the supremum \(L_{1}\) norm for conditional density estimation
- Approximate Bayesian Inference by Adaptive Quantization of the Hypothesis Space
- A conditional density estimation partition model using logistic Gaussian processes
- Partition-based conditional density estimation
- scientific article; zbMATH DE number 3413673 (Why is no real title available?)
- Optimal auxiliary priors and reversible jump proposals for a class of variable dimension models
- Adaptive Bayesian density regression for high-dimensional data
- Density Forecasts in Panel Data Models: A Semiparametric Bayesian Perspective
- Covariate-Assisted Bayesian Graph Learning for Heterogeneous Data
- Predictive distributions and the market return: the role of market illiquidity
- Adaptive kernel conditional density estimation
- Nonparametric estimation of conditional densities by generalized random forests
- Bayesian inference in high-dimensional models
This page was built for publication: Adaptive Bayesian estimation of conditional densities
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5357394)
