Projection-based approximation and a duality with kernel methods (Q913418)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Projection-based approximation and a duality with kernel methods |
scientific article |
Statements
Projection-based approximation and a duality with kernel methods (English)
0 references
1989
0 references
Projection pursuit regression (PPR) and kernel regression (KR) are methods for estimating a smooth function of several variables from noisy data. The PPR method was introduced by \textit{J. H. Friedman} and \textit{W. Stuetzle} [J. Am. Stat. Assoc. 76, 817-823 (1981)] and the KR-method was discussed, for instance, by \textit{C. J. Stone} [Ann. Stat. 5, 595-645 (1977; Zbl 0366.62051)] and \textit{G. Collomb} [Int. Stat. Rev. 49, 75-93 (1981; Zbl 0471.62039)]. The KR-method is essentially a method based on local averaging and it is known that the performance of this method is poor in high dimensions. Earlier examples have suggested that the PPR approach performs better than the KR approach. Here the authors investigate the following questions: For what sorts of regression functions is this true? When and by how much do PPR methods reduce the curse of dimensionality? They consider a two-dimensional problem and show that both the methods are complementary in nature. For a given function, if one method offers a dimensionality reduction, the other does not.
0 references
L2-approximation error
0 references
Gaussian measure
0 references
minimax rate of
0 references
approximation
0 references
radial functions
0 references
harmonic functions
0 references
rates of
0 references
convergence
0 references
Hermite polynomials
0 references
angular smoothness
0 references
Laplacian
0 references
smoothness
0 references
Projection pursuit regression
0 references
kernel regression
0 references
noisy data
0 references
local averaging
0 references
curse of dimensionality
0 references
two-dimensional problem
0 references
dimensionality reduction
0 references