Approximation of conditional densities by smooth mixtures of regressions
From MaRDI portal
Publication:973883
Abstract: This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback--Leibler distance by different specifications of finite mixtures of normal regressions in which normal means and variances and mixing probabilities can depend on variables in the conditioning set (covariates). These models are a special case of models known as "mixtures of experts" in statistics and computer science literature. Flexible specifications include models in which only mixing probabilities, modeled by multinomial logit, depend on the covariates and, in the univariate case, models in which only means of the mixed normals depend flexibly on the covariates. Modeling the variance of the mixed normals by flexible functions of the covariates can weaken restrictions on the class of the approximable densities. Obtained results can be generalized to mixtures of general location scale densities. Rates of convergence and easy to interpret bounds are also obtained for different model specifications. These approximation results can be useful for proving consistency of Bayesian and maximum likelihood density estimators based on these models. The results also have interesting implications for applied researchers.
Recommendations
- Smooth density estimation with moment constraints using mixture distributions
- Regression density estimation using smooth adaptive Gaussian mixtures
- Smooth estimates of normal mixtures
- A Smooth Nonparametric Estimate of a Mixing Distribution Using Mixtures of Gaussians
- Maximum smoothed likelihood component density estimation in mixture models with known mixing proportions
Cites work
- scientific article; zbMATH DE number 50546 (Why is no real title available?)
- scientific article; zbMATH DE number 1222298 (Why is no real title available?)
- scientific article; zbMATH DE number 1099381 (Why is no real title available?)
- A mixture likelihood approach for generalized linear models
- Bayesian Analysis of Binary and Polychotomous Response Data
- Bayesian Inference in Mixtures-of-Experts and Hierarchical Mixtures-of-Experts Models With an Application to Speech Recognition
- Bayesian mixture of splines for spatially adaptive nonparametric regression
- Bayesian nonparametrics
- Conditional Choice Probabilities and the Estimation of Dynamic Models
- Discrete Parameter Variation: Efficient Estimation of a Switching Regression Model
- Error bounds for functional approximation and estimation using mixtures of experts
- Estimating Mixtures of Normal Distributions and Switching Regressions
- Finite mixture models
- Hierarchical mixtures-of-experts for exponential family regression models: Approximation and maximum likelihood estimation
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- Practical Bayesian Density Estimation Using Mixtures of Normals
- Regression density estimation using smooth adaptive Gaussian mixtures
- Smoothly mixing regressions
- The Calculation of Posterior Distributions by Data Augmentation
Cited in
(28)- Dynamic network data envelopment analysis with a sequential structure and behavioural-causal analysis: application to the Chinese banking industry
- A universal approximation theorem for mixture-of-experts models
- A note on the smoothness of densities
- Adaptive Bayesian estimation of conditional densities
- Bayesian artificial neural networks for frontier efficiency analysis
- Posterior consistency in conditional distribution estimation
- On the aggregation of probability assessments: regularized mixtures of predictive densities for eurozone inflation and real interest rates
- Approximation by finite mixtures of continuous density functions that vanish at infinity
- Adaptive Bayesian estimation of conditional discrete-continuous distributions with an application to stock market trading activity
- A non-asymptotic approach for model selection via penalization in high-dimensional mixture of experts models
- Evaluating consumers' choices of Medicare Part D plans: a study in behavioral welfare economics
- On approximations via convolution-defined mixture models
- Bayesian mixture modeling for spectral density estimation
- Posterior consistency in conditional density estimation by covariate dependent mixtures
- Maximum likelihood estimation in a semicontinuous survival model with covariates subject to detection limits
- Data science, big data and statistics
- Bayesian regression with heteroscedastic error density and parametric mean function
- Approximations of conditional probability density functions in Lebesgue spaces via mixture of experts models
- Bayesian modeling of joint and conditional distributions
- Generalized smooth finite mixtures
- Smoothly mixing regressions
- Covariate-Assisted Bayesian Graph Learning for Heterogeneous Data
- Bayesian Spectral Modeling for Multiple Time Series
- Density Forecasts in Panel Data Models: A Semiparametric Bayesian Perspective
- On convergence rates of mixtures of polynomial experts
- Incorporating causal modeling into data envelopment analysis for performance evaluation
- Relabelling algorithms for mixture models with applications for large data sets
- Bayesian regression with nonparametric heteroskedasticity
This page was built for publication: Approximation of conditional densities by smooth mixtures of regressions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q973883)
