Linear and convex aggregation of density estimators
From MaRDI portal
Abstract: We study the problem of linear and convex aggregation of estimators of a density with respect to the mean squared risk. We provide procedures for linear and convex aggregation and we prove oracle inequalities for their risks. We also obtain lower bounds showing that these procedures are rate optimal in a minimax sense. As an example, we apply general results to aggregation of multivariate kernel density estimators with different bandwidths. We show that linear and convex aggregates mimic the kernel oracles in asymptotically exact sense for a large class of kernels including Gaussian, Silverman's and Pinsker's ones. We prove that, for Pinsker's kernel, the proposed aggregates are sharp asymptotically minimax simultaneously over a large scale of Sobolev classes of densities. Finally, we provide simulations demonstrating performance of the convex aggregation procedure.
Recommendations
- Learning Theory and Kernel Machines
- Optimal exponential bounds for aggregation of density estimators
- Optimal exponential bounds for aggregation of estimators for the Kullback-Leibler loss
- Generalized mirror averaging and \(D\)-convex aggregation
- A combined strategy for multivariate density estimation
Cites work
- scientific article; zbMATH DE number 469135 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- scientific article; zbMATH DE number 837911 (Why is no real title available?)
- scientific article; zbMATH DE number 847282 (Why is no real title available?)
- Adaptive density estimation using the blockwise Stein method
- Aggregation for Gaussian regression
- An asymptotically optimal window selection rule for kernel density estimates
- Combinatorial methods in density estimation
- Exact mean integrated squared error
- From \(\varepsilon\)-entropy to KL-entropy: analysis of minimum information complexity density estima\-tion
- Functional aggregation for nonparametric regression.
- LAN in Problems of Nonparametric Estimation of Functions and Lower Bounds for Quadratic Risks
- Learning Theory and Kernel Machines
- Mixing strategies for density estimation.
- Model selection via testing: an alternative to (penalized) maximum likelihood estimators.
- Nonparametric estimation of smooth probability densities in \(L_ 2\)
- On estimating a density using Hellinger distance and some other strange facts
- Optimal filtering of square-integrable signals in Gaussian noise
- Optimal rates and constants in \(L_ 2\)-minimax estimation of probability density functions
- Quasi-universal bandwidth selection for kernel density estimators
- Statistical learning theory and stochastic optimization. Ecole d'Eté de Probabilitiés de Saint-Flour XXXI -- 2001.
Cited in
(53)- A combined strategy for multivariate density estimation
- On aggregation of uncensored and censored observations
- Aggregation of spectral density estimators
- A general procedure to combine estimators
- A MOM-based ensemble method for robustness, subsampling and hyperparameter tuning
- Aggregation of affine estimators
- Bagging of density estimators
- Optimal Kernel Selection for Density Estimation
- Optimal exponential bounds for aggregation of estimators for the Kullback-Leibler loss
- Adaptive estimation over anisotropic functional classes via oracle approach
- Estimator selection with respect to Hellinger-type risks
- Nonparametric estimation of the anisotropic probability density of mixed variables
- Performance of empirical risk minimization in linear aggregation
- Oracle inequalities and upper bounds for kernel density estimators on manifolds and more general metric spaces
- Better than the best? Answers via model ensemble in density-based clustering
- Sharp adaptive drift estimation for ergodic diffusions: the multivariate case
- Optimal exponential bounds for aggregation of density estimators
- Sampling from non-smooth distributions through Langevin diffusion
- An introduction to nonparametric adaptive estimation
- Optimal model selection in density estimation
- Multivariate density estimation under sup-norm loss: oracle approach, adaptation and independence structure
- Sharp oracle inequalities for low-complexity priors
- The two-sample problem for Poisson processes: adaptive tests with a nonasymptotic wild bootstrap approach
- Spatial aggregation of local likelihood estimates with applications to classification
- Random average shifted histograms
- Ordered smoothers with exponential weighting
- Estimator selection in the Gaussian setting
- Generalized mirror averaging and \(D\)-convex aggregation
- Sharp oracle inequalities for aggregation of affine estimators
- A new approach to estimator selection
- Aggregation of estimators and stochastic optimization
- Kullback-Leibler aggregation and misspecified generalized linear models
- Bandwidth selection in kernel density estimation: oracle inequalities and adaptive minimax optimality
- Sparse estimation by exponential weighting
- Model selection for density estimation with \(\mathbb L_2\)-loss
- Localized Gaussian width of \(M\)-convex hulls with applications to Lasso and convex aggregation
- Bandwidth selection for kernel density estimation: a review of fully automatic selectors
- Fast adaptive estimation of log-additive exponential models in Kullback-Leibler divergence
- A data-driven kernel estimator of the density function
- Optimal Kullback-Leibler aggregation in mixture density estimation by maximum likelihood
- SPADES and mixture models
- PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting
- Optimal bounds for aggregation of affine estimators
- Statistical estimation with model selection
- Density estimation with stagewise optimization of the empirical risk
- On adaptive minimax density estimation on \(\mathbb R^d\)
- A unified scheme for generalizing cardinality estimators to sum aggregation
- Aggregating estimates by convex optimization
- Oracle inequalities and adaptive estimation in the convolution structure density model
- Stacked grenander and rearrangement estimators of a discrete distribution
- scientific article; zbMATH DE number 5957353 (Why is no real title available?)
- Concentration inequalities for the exponential weighting method
- Averaging of density kernel estimators
This page was built for publication: Linear and convex aggregation of density estimators
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q734530)
