Adaptive Bayesian estimation of conditional densities
From MaRDI portal
Abstract: We consider a non-parametric Bayesian model for conditional densities. The model is a finite mixture of normal distributions with covariate dependent multinomial logit mixing probabilities. A prior for the number of mixture components is specified on positive integers. The marginal distribution of covariates is not modeled. We study asymptotic frequentist behavior of the posterior in this model. Specifically, we show that when the true conditional density has a certain smoothness level, then the posterior contraction rate around the truth is equal up to a log factor to the frequentist minimax rate of estimation. An extension to the case when the covariate space is unbounded is also established. As our result holds without a priori knowledge of the smoothness level of the true density, the established posterior contraction rates are adaptive. Moreover, we show that the rate is not affected by inclusion of irrelevant covariates in the model. In Monte Carlo simulations, a version of the model compares favorably to a cross-validated kernel conditional density estimator.
Recommendations
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- Empirical Bayes conditional density estimation
- Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
- A consistent nonparametric Bayesian procedure for estimating autoregressive conditional den\-sities
- Nonparametric Bayesian model selection and averaging
Cites work
- scientific article; zbMATH DE number 2135362 (Why is no real title available?)
- Adaptive Bayesian density estimation with location-scale mixtures
- Adaptive Bayesian density regression for high-dimensional data
- Adaptive Bayesian estimation using a Gaussian random field with inverse gamma bandwidth
- Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
- Adaptive nonparametric Bayesian inference using location-scale mixture priors
- An ANOVA Model for Dependent Random Measures
- Anisotropic function estimation using multi-bandwidth Gaussian processes
- Approximation of conditional densities by smooth mixtures of regressions
- Bayesian Density Regression
- Bayesian Inference in Mixtures-of-Experts and Hierarchical Mixtures-of-Experts Models With an Application to Speech Recognition
- Bayesian density regression with logistic Gaussian process and subspace projection
- Bayesian mixture of splines for spatially adaptive nonparametric regression
- Bayesian modeling of joint and conditional distributions
- Conditional density estimation in a regression setting
- Convergence rates for Bayesian density estimation of infinite-dimensional exponential families
- Convergence rates for posterior distributions and adaptive estimation
- Convergence rates of posterior distributions.
- Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities.
- Flexible modeling of conditional distributions using smooth mixtures of asymmetric Student \(t\) densities
- Generalized smooth finite mixtures
- Improving prediction from Dirichlet process mixtures via enrichment
- Kernel stick-breaking processes
- Minimax-optimal nonparametric regression in high dimensions
- Nonparametric Bayes conditional distribution modeling with variable selection
- Nonparametric econometrics. Theory and practice.
- Order-Based Dependent Dirichlet Processes
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- Posterior consistency in conditional distribution estimation
- Posterior consistency of Dirichlet mixtures in density estimation
- Posterior convergence rates of Dirichlet mixtures at smooth densities
- Rates of convergence for the posterior distributions of mixtures of betas and adaptive nonparametric estimation of the density
- Regression density estimation using smooth adaptive Gaussian mixtures
- Smoothly mixing regressions
- The consistency of posterior distributions in nonparametric problems
Cited in
(25)- Adaptive estimation of the conditional cumulative distribution function from current status data
- Bayesian adaptive estimation: the next dimension
- A consistent nonparametric Bayesian procedure for estimating autoregressive conditional den\-sities
- Predictive distributions and the market return: the role of market illiquidity
- Adaptive-modal Bayesian nonparametric regression
- Adaptive kernel conditional density estimation
- Contraction properties of shrinkage priors in logistic regression
- Empirical Bayes conditional density estimation
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- scientific article; zbMATH DE number 3413673 (Why is no real title available?)
- Partition-based conditional density estimation
- Approximate Bayesian Inference by Adaptive Quantization of the Hypothesis Space
- Adaptive method for indirect identification of the statistical properties of random fields in a Bayesian framework
- Adaptive Bayesian density regression for high-dimensional data
- Optimal auxiliary priors and reversible jump proposals for a class of variable dimension models
- Adaptive Bayesian estimation of conditional discrete-continuous distributions with an application to stock market trading activity
- Nonparametric estimation of conditional densities by generalized random forests
- Density Forecasts in Panel Data Models: A Semiparametric Bayesian Perspective
- A review of uncertainty quantification for density estimation
- Covariate-Assisted Bayesian Graph Learning for Heterogeneous Data
- On adaptive Bayesian inference
- Posterior asymptotics in the supremum \(L_{1}\) norm for conditional density estimation
- Bayesian nonparametric vector autoregressive models
- A non-asymptotic approach for model selection via penalization in high-dimensional mixture of experts models
- A conditional density estimation partition model using logistic Gaussian processes
This page was built for publication: Adaptive Bayesian estimation of conditional densities
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5357394)
