Risk bounds for model selection via penalization
From MaRDI portal
Publication:1291160
DOI10.1007/s004400050210zbMath0946.62036OpenAlexW1996268356MaRDI QIDQ1291160
Pascal Massart, Lucien Birgé, Andrew R. Barron
Publication date: 3 June 1999
Published in: Probability Theory and Related Fields (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/s004400050210
Density estimation (62G07) Nonparametric estimation (62G05) Rate of convergence, degree of approximation (41A25)
Related Items
Upper functions for \(\mathbb{L}_{p}\)-norms of Gaussian random fields, Nonparametric weighted estimators for biased data, Another look at statistical learning theory and regularization, Near-ideal model selection by \(\ell _{1}\) minimization, Adaptive Bayesian estimation using a Gaussian random field with inverse gamma bandwidth, Adaptive pointwise estimation of conditional density function, Nonparametric denoising of signals with unknown local structure. I: Oracle inequalities, Sparsity in penalized empirical risk minimization, Bounding the expectation of the supremum of an empirical process over a (weak) VC-major class, An exponential inequality under weak dependence, Minimal penalty for Goldenshluger-Lepski method, Oracle inequalities for the stochastic differential equations, Divergence rates of Markov order estimators and their application to statistical estimation of stationary ergodic processes, Upper functions for positive random functionals. I: General setting and Gaussian random functions, Optimal adaptive estimation of a quadratic functional, Risk bounds for statistical learning, Adaptive confidence sets in \(L^2\), Rates of convergence of estimates, Kolmogorov's entropy and the dimensionality reduction principle in regression, Bin width selection in multivariate histograms by the combinatorial method, Nearly optimal minimax estimator for high-dimensional sparse linear regression, Honest and adaptive confidence sets in \(L_p\), Image denoising: Pointwise adaptive approach, Model selection in nonparametric regression, Nonparametric density estimation in presence of bias and censoring, Estimator selection: a new method with applications to kernel density estimation, Nonlinear orthogonal series estimates for random design regression, A Bernstein-type inequality for suprema of random processes with applications to model selection in non-Gaussian regression, Adaptive estimation of a distribution function and its density in sup-norm loss by wavelet and spline projections, Non-asymptotic adaptive prediction in functional linear models, Convolution power kernels for density estimation, General model selection estimation of a periodic regression with a Gaussian noise, The rate of the convergence of the mean score in random sequence comparison, Segmentation of the mean of heteroscedastic data via cross-validation, Optimal model selection in density estimation, A new approach to estimator selection, General nonexact oracle inequalities for classes with a subexponential envelope, Estimator selection with respect to Hellinger-type risks, Risk hull method and regularization by projections of ill-posed inverse problems, Simultaneous confidence bands for Yule-Walker estimators and order selection, On the number of groups in clustering, Sieve-based confidence intervals and bands for Lévy densities, Margin-adaptive model selection in statistical learning, Complexity penalized support estimation., Optimal model selection for density estimation of stationary data under various mixing condi\-tions, Parametric or nonparametric? A parametricness index for model selection, Uniform bounds for norms of sums of independent random functions, Compound decision theory and empirical Bayes methods, Robust model selection for a semimartingale continuous time regression from discrete data, Model selection for simplicial approximation, Minimax-rate adaptive nonparametric regression with unknown correlations of errors, Multivariate orthogonal series estimates for random design regression, Sobolev-Hermite versus Sobolev nonparametric density estimation on \(\mathbb{R}\), Optimal adaptive estimation of the relative density, Fast adaptive estimation of log-additive exponential models in Kullback-Leibler divergence, A new method for estimation and model selection: \(\rho\)-estimation, Adaptive estimation of the hazard rate with multiplicative censoring, Structural adaptation via \(\mathbb L_p\)-norm oracle inequalities, Non-parametric estimation of the diffusion coefficient from noisy data, Model selection for Gaussian regression with random design, Minimax estimation of the conditional cumulative distribution function, Adaptive estimation of mean and volatility functions in (auto-)regressive models., A new algorithm for fixed design regression and denoising, Asymptotically exact minimax estimation in sup-norm for anisotropic Hölder classes, The principle of penalized empirical risk in severely ill-posed problems, A survey of cross-validation procedures for model selection, Density estimation by the penalized combinatorial method, Monte Carlo algorithms for optimal stopping and statistical learning, Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment, Minimax and minimax adaptive estimation in multiplicative regression: locally Bayesian approach, Parallel implementation of wavelet-based image denoising on programmable PC-grade graphics hardware, New dependence coefficients. Examples and applications to statistics, General empirical Bayes wavelet methods and exactly adaptive minimax estimation, A cross-validation based estimation of the proportion of true null hypotheses, Detection of multiple changes in a sequence of dependent variables, Mixing least-squares estimators when the variance is unknown, Evaluation and selection of models for out-of-sample prediction when the sample size is small relative to the complexity of the data-generating process, Robust forecast combinations, Estimating the intensity of a random measure by histogram type estimators, Penalized projection estimators of the Aalen multiplicative intensity, Adaptive functional linear regression, Nonparametric adaptive estimation for integrated diffusions, On the stability of the risk hull method for projection estimators, APPLE: approximate path for penalized likelihood estimators, Global risk bounds and adaptation in univariate convex regression, Empirical Bayesian test of the smoothness, Gaussian model selection with an unknown variance, An improved model averaging scheme for logistic regression, Regression function estimation as a partly inverse problem, Information-theoretic determination of minimax rates of convergence, Inequalities for uniform deviations of averages from expectations with applications to nonparametric regression, Combining different procedures for adaptive regression, Smooth discrimination analysis, Mixing strategies for density estimation., Adaptive estimation of a quadratic functional by model selection., Rates of convergence of posterior distributions., Adaptive estimation in autoregression or \(\beta\)-mixing regression via model selection, Sharp adaptive estimation of linear functionals., Random rates in anisotropic regression. (With discussion), Lower bounds for the rate of convergence in nonparametric pattern recognition, Adaptive estimation of the baseline hazard function in the Cox model by model selection, with high-dimensional covariates, ADAPTIVE ESTIMATION IN A HETEROSCEDASTIC NONPARAMETRIC REGRESSION, Exact adaptive pointwise estimation on Sobolev classes of densities, Model selection for (auto-)regression with dependent data, L0-Regularized Learning for High-Dimensional Additive Hazards Regression, Sequential nonparametric estimation of controlled multivariate regression, Penalized contrast estimation in functional linear models with circular data, PREDICTION/ESTIMATION WITH SIMPLE LINEAR MODELS: IS IT REALLY THAT SIMPLE?, Unnamed Item, Adaptive and efficient estimation in the Gaussian sequence model, Concentration inequalities for Poisson point processes with application to adaptive intensity estimation, Robust feature screening procedures for single and mixed types of data, Unnamed Item, Lasso in Infinite dimension: application to variable selection in functional multivariate linear regression, Robust High-Dimensional Regression with Coefficient Thresholding and Its Application to Imaging Data Analysis, Density estimation under local differential privacy and Hellinger loss, Nonparametric multiple regression by projection on non-compactly supported bases, Theory of adaptive estimation, Unnamed Item, Comparing and Weighting Imperfect Models Using D-Probabilities, Adaptive nonparametric drift estimation of an integrated jump diffusion process, Unnamed Item, Some applications of concentration inequalities to statistics, ADAPTIVE ESTIMATION OF FUNCTIONALS IN NONPARAMETRIC INSTRUMENTAL REGRESSION, Thresholding algorithms, maxisets and well-concentrated bases, Adaptive Gaussian Inverse Regression with Partially Unknown Operator, The Stein hull, Model selection for estimating the non zero components of a Gaussian vector, Bandwidth Selection for Local Linear Regression Smoothers, An Invitation to Quantum Tomography, Consistency of Bernstein Polynomial Posteriors, Random thresholds for linear model selection, Nonparametric regression function estimation using interaction least squares splines and complexity regularization., Sharp non-asymptotic oracle inequalities for non-parametric heteroscedastic regression models, Inconsistency of the MLE for the Joint Distribution of Interval‐Censored Survival Times and Continuous Marks, Order Determination in Nonlinear Time Series by Penalized Least-Squares, Sharp oracle inequalities and slope heuristic for specification probabilities estimation in discrete random fields, The EBIC and a sequential procedure for feature selection in interactive linear models with high-dimensional data, High-dimensional regression with unknown variance, Likelihood adaptively modified penalties, Sequential model selection method for nonparametric autoregression, Adaptive Estimation of Hazard Rate with Censored Data, Improved robust model selection methods for a Lévy nonparametric regression in continuous time, Adaptive estimators for nonparametric heteroscedastic regression models, Adaptive estimation with soft thresholding penalties, A comparison of automatic histogram constructions, Graph signal denoising using \(t\)-shrinkage priors, Consistent covariate selection and post model selection inference in semiparametric regression., Multiscale likelihood analysis and complexity penalized estimation., Convergence rates for posterior distributions and adaptive estimation, Semiparametric Estimation by Model Selection for Locally Stationary Processes, Minimal penalties for Gaussian model selection, Data-adaptive estimation of the treatment-specific mean, On robust learning in the canonical change point problem under heavy tailed errors in finite and growing dimensions, Empirical variance minimization with applications in variance reduction and optimal control, Local Rademacher complexities and oracle inequalities in risk minimization. (2004 IMS Medallion Lecture). (With discussions and rejoinder), Concentration inequalities, counting processes and adaptive statistics, On improved loss estimation for shrinkage estimators, Central Limit Theorems for the Non-Parametric Estimation of Time-Changed Lévy Models, Optimal dyadic decision trees, Statistical estimation with model selection, Multivariate intensity estimation via hyperbolic wavelet selection, Efficient robust nonparametric estimation in a semimartingale regression model, Adaptive estimation of linear functionals in functional linear models, Adaptive density estimation on bounded domains under mixing conditions, Sharp oracle inequalities for aggregation of affine estimators, On the nonparametric maximum likelihood estimator for Gaussian location mixture densities with application to Gaussian denoising, Least squares type estimation of the transition density of a particular hidden Markov chain, Model selection: from theory to practice, Adaptive estimation of the conditional intensity of marker-dependent counting processes, Nonparametric estimation for stochastic volatility models, Non-parametric adaptive estimation of the drift for a jump diffusion process, Adaptive circular deconvolution by model selection under unknown error distribution, Honest adaptive confidence bands and self-similar functions, Oracle inequalities for cross-validation type procedures, Selecting the length of a principal curve within a Gaussian model, Optimal model selection in heteroscedastic regression using piecewise polynomial functions, Adaptive complexity regularization for linear inverse problems, Adaptive estimation of linear functionals by model selection, Simultaneous estimation of the mean and the variance in heteroscedastic Gaussian regression, Cumulative distribution function estimation under interval censoring case 1, General oracle inequalities for model selection, Model selection by resampling penalization, Dimension reduction and variable selection in case control studies via regularized likelihood optimization, Plugin procedure in segmentation and application to hyperspectral image segmentation, The adaptive and the thresholded Lasso for potentially misspecified models (and a lower bound for the Lasso), Inhomogeneous and anisotropic conditional density estimation from dependent data, Adaptive estimation in circular functional linear models, Estimating composite functions by model selection, Warped bases for conditional density estimation, Model selection and sharp asymptotic minimaxity, Adaptively combined forecasting for discrete response time series, Adaptive kernel methods using the balancing principle, A general framework for Bayes structured linear models, Combining regular and irregular histograms by penalized likelihood, Anisotropic function estimation using multi-bandwidth Gaussian processes, A look at robustness and stability of \(\ell_1\)-versus \(\ell_0\)-regularization: discussion of papers by Bertsimas et al. and Hastie et al., Aggregation for Gaussian regression, Improved model selection method for a regression function with dependent noise, Penalized nonparametric mean square estimation of the coefficients of diffusion processes, The Goldenshluger-Lepski method for constrained least-squares estimators over RKHSs, Nonparametric estimation of jump rates for a specific class of piecewise deterministic Markov processes, Nonparametric estimation of the stationary density and the transition density of a Markov chain, Approximate \(\ell_0\)-penalized estimation of piecewise-constant signals on graphs, The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder)., Asymptotic analysis of model selection criteria for general hidden Markov models, Adaptive sequential estimation for ergodic diffusion processes in quadratic metric, Conditional mean residual life estimation, Optimal estimation of variance in nonparametric regression with random design, Adaptive estimation of the transition density of a particular hidden Markov chain, Covariate selection for semiparametric hazard function regression models, Adaptation to anisotropy and inhomogeneity via dyadic piecewise polynomial selection, Maxisets for model selection, Adaptive nonparametric confidence sets, Asymptotically efficient estimates for nonparametric regression models, Drift estimation on non compact support for diffusion models, Testing the order of a model, Model selection for the robust efficient signal processing observed with small Lévy noise, Non parametric estimation of the diffusion coefficients of a diffusion with jumps, Low Complexity Regularization of Linear Inverse Problems, On risk bounds in isotonic and other shape restricted regression problems, Adaptive regression estimation with multilayer feedforward neural networks, Estimating a density, a hazard rate, and a transition intensity via the \(\rho\)-estimation method, Theory of Classification: a Survey of Some Recent Advances, How many bins should be put in a regular histogram, Oracle posterior contraction rates under hierarchical priors, A MOM-based ensemble method for robustness, subsampling and hyperparameter tuning, Minimax bounds for Besov classes in density estimation, Estimates for the SVD of the truncated Fourier transform on \(L^2(\cosh (B|\cdot |))\) and stable analytic continuation, Risk hull method for spectral regularization in linear statistical inverse problems, Regression function estimation on non compact support in an heteroscesdastic model, Set structured global empirical risk minimizers are rate optimal in general dimensions, Post-Model-Selection Method for Density Estimation, Bayesian linear size-and-shape regression with applications to face data, Non-parametric Poisson regression from independent and weakly dependent observations by model selection, An oracle inequality for penalised projection estimation of Lévy densities from high-frequency observations, Adaptive procedure for Fourier estimators: application to deconvolution and decompounding, Square root penalty: Adaption to the margin in classification and in edge estimation, Nonparametric intensity estimation from noisy observations of a Poisson process under unknown error distribution, Asymptotic Equivalence of Regularization Methods in Thresholded Parameter Space, Testing the regularity of a smooth signal, Estimation and model selection for model-based clustering with the conditional classification likelihood, M-estimation using penalties or sieves, Free knot splines in concave extended linear modeling, Adaptive estimation over anisotropic functional classes via oracle approach, Model selection for regression on a random design
