Linear and convex aggregation of density estimators
From MaRDI portal
(Redirected from Publication:734530)
Abstract: We study the problem of linear and convex aggregation of estimators of a density with respect to the mean squared risk. We provide procedures for linear and convex aggregation and we prove oracle inequalities for their risks. We also obtain lower bounds showing that these procedures are rate optimal in a minimax sense. As an example, we apply general results to aggregation of multivariate kernel density estimators with different bandwidths. We show that linear and convex aggregates mimic the kernel oracles in asymptotically exact sense for a large class of kernels including Gaussian, Silverman's and Pinsker's ones. We prove that, for Pinsker's kernel, the proposed aggregates are sharp asymptotically minimax simultaneously over a large scale of Sobolev classes of densities. Finally, we provide simulations demonstrating performance of the convex aggregation procedure.
Recommendations
Cites work
- scientific article; zbMATH DE number 469135 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- scientific article; zbMATH DE number 837911 (Why is no real title available?)
- scientific article; zbMATH DE number 847282 (Why is no real title available?)
- Adaptive density estimation using the blockwise Stein method
- Aggregation for Gaussian regression
- An asymptotically optimal window selection rule for kernel density estimates
- Combinatorial methods in density estimation
- Exact mean integrated squared error
- From -entropy to KL-entropy: analysis of minimum information complexity density estima\-tion
- Functional aggregation for nonparametric regression.
- LAN in Problems of Nonparametric Estimation of Functions and Lower Bounds for Quadratic Risks
- Learning Theory and Kernel Machines
- Mixing strategies for density estimation.
- Model selection via testing: an alternative to (penalized) maximum likelihood estimators.
- Nonparametric estimation of smooth probability densities in \(L_ 2\)
- On estimating a density using Hellinger distance and some other strange facts
- Optimal filtering of square-integrable signals in Gaussian noise
- Optimal rates and constants in \(L_ 2\)-minimax estimation of probability density functions
- Quasi-universal bandwidth selection for kernel density estimators
- Statistical learning theory and stochastic optimization. Ecole d'Eté de Probabilitiés de Saint-Flour XXXI -- 2001.
Cited in
(58)- Optimal transport map estimation in general function spaces
- Aggregation of affine estimators
- Sharp oracle inequalities for aggregation of affine estimators
- On adaptive minimax density estimation on R^d
- Aggregation of estimators and stochastic optimization
- Localized Gaussian width of \(M\)-convex hulls with applications to Lasso and convex aggregation
- A new approach to estimator selection
- Studentized tests of independence: random-lifter approach
- Bandwidth selection in kernel density estimation: oracle inequalities and adaptive minimax optimality
- Optimal Kullback-Leibler aggregation in mixture density estimation by maximum likelihood
- Oracle inequalities and adaptive estimation in the convolution structure density model
- Optimal model selection in density estimation
- Performance of empirical risk minimization in linear aggregation
- Pointwise density estimation on metric spaces and applications in seismology
- A data-driven kernel estimator of the density function
- Random average shifted histograms
- Bandwidth selection for kernel density estimation: a review of fully automatic selectors
- Fast adaptive estimation of log-additive exponential models in Kullback-Leibler divergence
- On aggregation of uncensored and censored observations
- Sharp adaptive drift estimation for ergodic diffusions: the multivariate case
- Sharp oracle inequalities for low-complexity priors
- Optimal exponential bounds for aggregation of estimators for the Kullback-Leibler loss
- Optimal bounds for aggregation of affine estimators
- Adaptive estimation over anisotropic functional classes via oracle approach
- Optimal Kernel Selection for Density Estimation
- A general procedure to combine estimators
- Density estimation with stagewise optimization of the empirical risk
- Generalized mirror averaging and D-convex aggregation
- Spatial aggregation of local likelihood estimates with applications to classification
- A combined strategy for multivariate density estimation
- SPADES and mixture models
- Concentration inequalities for the exponential weighting method
- scientific article; zbMATH DE number 5957353 (Why is no real title available?)
- Kullback-Leibler excess risk bounds for exponential weighted aggregation in generalized linear models
- A MOM-based ensemble method for robustness, subsampling and hyperparameter tuning
- Aggregation of spectral density estimators
- Oracle inequalities and upper bounds for kernel density estimators on manifolds and more general metric spaces
- Optimal exponential bounds for aggregation of density estimators
- Estimator selection in the Gaussian setting
- A unified scheme for generalizing cardinality estimators to sum aggregation
- Stacked grenander and rearrangement estimators of a discrete distribution
- Bagging of density estimators
- Better than the best? Answers via model ensemble in density-based clustering
- Semi-supervised U-statistics
- Averaging of density kernel estimators
- Model selection for density estimation with \(\mathbb L_2\)-loss
- Kullback-Leibler aggregation and misspecified generalized linear models
- Multivariate density estimation under sup-norm loss: oracle approach, adaptation and independence structure
- Sampling from non-smooth distributions through Langevin diffusion
- Nonparametric estimation of the anisotropic probability density of mixed variables
- The two-sample problem for Poisson processes: adaptive tests with a nonasymptotic wild bootstrap approach
- Ordered smoothers with exponential weighting
- PAC-Bayesian risk bounds for group-analysis sparse regression by exponential weighting
- Estimator selection with respect to Hellinger-type risks
- Sparse estimation by exponential weighting
- An introduction to nonparametric adaptive estimation
- Aggregating estimates by convex optimization
- Statistical estimation with model selection
This page was built for publication: Linear and convex aggregation of density estimators
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q734530)
