Linear and convex aggregation of density estimators
From MaRDI portal
Abstract: We study the problem of linear and convex aggregation of estimators of a density with respect to the mean squared risk. We provide procedures for linear and convex aggregation and we prove oracle inequalities for their risks. We also obtain lower bounds showing that these procedures are rate optimal in a minimax sense. As an example, we apply general results to aggregation of multivariate kernel density estimators with different bandwidths. We show that linear and convex aggregates mimic the kernel oracles in asymptotically exact sense for a large class of kernels including Gaussian, Silverman's and Pinsker's ones. We prove that, for Pinsker's kernel, the proposed aggregates are sharp asymptotically minimax simultaneously over a large scale of Sobolev classes of densities. Finally, we provide simulations demonstrating performance of the convex aggregation procedure.
Recommendations
Cites work
- Adaptive density estimation using the blockwise Stein method
- Aggregation for Gaussian regression
- An asymptotically optimal window selection rule for kernel density estimates
- Combinatorial methods in density estimation
- Exact mean integrated squared error
- From -entropy to KL-entropy: analysis of minimum information complexity density estima\-tion
- Functional aggregation for nonparametric regression.
- scientific article; zbMATH DE number 469135 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- scientific article; zbMATH DE number 837911 (Why is no real title available?)
- scientific article; zbMATH DE number 847282 (Why is no real title available?)
- LAN in Problems of Nonparametric Estimation of Functions and Lower Bounds for Quadratic Risks
- Learning Theory and Kernel Machines
- Mixing strategies for density estimation.
- Model selection via testing: an alternative to (penalized) maximum likelihood estimators.
- Nonparametric estimation of smooth probability densities in \(L_ 2\)
- On estimating a density using Hellinger distance and some other strange facts
- Optimal filtering of square-integrable signals in Gaussian noise
- Optimal rates and constants in \(L_ 2\)-minimax estimation of probability density functions
- Quasi-universal bandwidth selection for kernel density estimators
- Statistical learning theory and stochastic optimization. Ecole d'Eté de Probabilitiés de Saint-Flour XXXI -- 2001.
Cited in
(58)- Estimator selection in the Gaussian setting
- Bandwidth selection for kernel density estimation: a review of fully automatic selectors
- Random average shifted histograms
- A general procedure to combine estimators
- A new approach to estimator selection
- Oracle inequalities and adaptive estimation in the convolution structure density model
- Optimal Kullback-Leibler aggregation in mixture density estimation by maximum likelihood
- Fast adaptive estimation of log-additive exponential models in Kullback-Leibler divergence
- Optimal bounds for aggregation of affine estimators
- Sharp oracle inequalities for aggregation of affine estimators
- A MOM-based ensemble method for robustness, subsampling and hyperparameter tuning
- Better than the best? Answers via model ensemble in density-based clustering
- Sampling from non-smooth distributions through Langevin diffusion
- Aggregating estimates by convex optimization
- Stacked grenander and rearrangement estimators of a discrete distribution
- Aggregation of estimators and stochastic optimization
- Bagging of density estimators
- Averaging of density kernel estimators
- Sharp oracle inequalities for low-complexity priors
- Localized Gaussian width of \(M\)-convex hulls with applications to Lasso and convex aggregation
- Sharp adaptive drift estimation for ergodic diffusions: the multivariate case
- Adaptive estimation over anisotropic functional classes via oracle approach
- Density estimation with stagewise optimization of the empirical risk
- Statistical estimation with model selection
- Optimal exponential bounds for aggregation of estimators for the Kullback-Leibler loss
- PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting
- Aggregation of affine estimators
- Model selection for density estimation with \(\mathbb L_2\)-loss
- Spatial aggregation of local likelihood estimates with applications to classification
- Performance of empirical risk minimization in linear aggregation
- Optimal Kernel Selection for Density Estimation
- scientific article; zbMATH DE number 5957353 (Why is no real title available?)
- Multivariate density estimation under sup-norm loss: oracle approach, adaptation and independence structure
- The two-sample problem for Poisson processes: adaptive tests with a nonasymptotic wild bootstrap approach
- Ordered smoothers with exponential weighting
- On adaptive minimax density estimation on R^d
- Optimal model selection in density estimation
- Kullback-Leibler aggregation and misspecified generalized linear models
- Concentration inequalities for the exponential weighting method
- Aggregation of spectral density estimators
- A unified scheme for generalizing cardinality estimators to sum aggregation
- A combined strategy for multivariate density estimation
- Optimal exponential bounds for aggregation of density estimators
- An introduction to nonparametric adaptive estimation
- Oracle inequalities and upper bounds for kernel density estimators on manifolds and more general metric spaces
- A data-driven kernel estimator of the density function
- Sparse estimation by exponential weighting
- Nonparametric estimation of the anisotropic probability density of mixed variables
- Bandwidth selection in kernel density estimation: oracle inequalities and adaptive minimax optimality
- Estimator selection with respect to Hellinger-type risks
- On aggregation of uncensored and censored observations
- Semi-supervised U-statistics
- Optimal transport map estimation in general function spaces
- Studentized tests of independence: random-lifter approach
- Pointwise density estimation on metric spaces and applications in seismology
- Kullback-Leibler excess risk bounds for exponential weighted aggregation in generalized linear models
- Generalized mirror averaging and D-convex aggregation
- SPADES and mixture models
This page was built for publication: Linear and convex aggregation of density estimators
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q734530)
