Adaptive estimation in the single-index model via oracle approach

DOI10.3103/S1066530713040030zbMATH Open1283.62077arXiv1111.3563MaRDI QIDQ2439930FDOQ2439930

Authors: Nora Serdyukova, O. V. Lepski 

Publication date: 26 March 2014

Published in: Mathematical Methods of Statistics (Search for Journal in Brave)

Abstract: In the framework of nonparametric multivariate function estimation we are interested in structural adaptation. We assume that the function to be estimated has the "single-index" structure where neither the link function nor the index vector is known. We suggest a novel procedure that adapts simultaneously to the unknown index and smoothness of the link function. For the proposed procedure, we prove a "local" oracle inequality (described by the pointwise seminorm), which is then used to obtain the upper bound on the maximal risk of the adaptive estimator under assumption that the link function belongs to a scale of H"{o}lder classes. The lower bound on the minimax risk shows that in the case of estimating at a given point the constructed estimator is optimally rate adaptive over the considered range of classes. For the same procedure we also establish a "global" oracle inequality (under the $L_r$ norm, $r<infty$) and examine its performance over the Nikol'skii classes. This study shows that the proposed method can be applied to estimating functions of inhomogeneous smoothness, that is whose smoothness may vary from point to point.

Full work available at URL: https://arxiv.org/abs/1111.3563

Recommendations

• Adaptive estimation under single-index constraint in a regression model
• Adaptive estimation over anisotropic functional classes via oracle approach
• Structural adaptation via \(\mathbb L_p\)-norm oracle inequalities
• Optimal rates and adaptation in the single-index model using aggregation
• The adaptive LASSO spline estimation of single-index model

zbMATH Keywords

oracle inequalitieslower boundsminimax rate of convergenceGaussian white noisenonparametric function estimationstructural adaptation

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Density estimation (62G07) Asymptotic properties of nonparametric inference (62G20) Estimation in multivariate analysis (62H12)

Cites Work

• Title not available (Why is that?)
• Semi-parametric estimation of partially linear single-index models
• Title not available (Why is that?)
• Generalized Partially Linear Single-Index Models
• Title not available (Why is that?)
• Estimation and testing for partially linear single-index models
• Additive regression and other nonparametric models
• Slicing regression: A link-free regression method
• Semiparametric methods in econometrics
• Investigating Smooth Multiple Regression by the Method of Average Derivatives
• Nonparametric and semiparametric models.
• A distribution-free theory of nonparametric regression
• Direct estimation of the index coefficient in a single-index model
• Structure adaptive approach for dimension reduction.
• Adapting for the missing link
• On semiparametric \(M\)-estimation in single-index regression
• On Single-Index Coefficient Regression Models
• Structural adaptation via \(\mathbb L_p\)-norm oracle inequalities
• Nonlinear Estimation in Anisotropic Multi-Index Denoising. Sparse Case
• On extended partially linear single-index models
• Optimal rates and adaptation in the single-index model using aggregation
• Optimal spatial adaptation to inhomogeneous smoothness: An approach based on kernel estimates with variable bandwidth selectors
• Title not available (Why is that?)
• Universal pointwise selection rule in multivariate function estimation
• On minimax wavelet estimators
• Adaptive nonparametric estimation of smooth multivariate functions.
• Title not available (Why is that?)
• On pointwise adaptive curve estimation based on inhomogeneous data
• Minimax and minimax adaptive estimation in multiplicative regression: locally Bayesian approach
• Semiparametric \(M\)-estimators in single-index models
• Iteratively Regularized Gauss–Newton Method for Nonlinear Inverse Problems with Random Noise
• Maxiset in sup-norm for kernel estimators
• Mathematical statistics. Asymptotic minimax theory
• Spatial adaptation in heteroscedastic regression: propagation approach

Cited In (4)

• Adaptive estimation in the functional nonparametric regression model
• Lower bounds in estimation at a point under multi-index constraint
• Efficient estimation in single index models through smoothing splines
• A concentration inequality for a Gaussian process indexed by matrices

This page was built for publication: Adaptive estimation in the single-index model via oracle approach

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2439930)