Vapnik-Chervonenkis type conditions and uniform Donsker classes of functions (Q1431502)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Vapnik-Chervonenkis type conditions and uniform Donsker classes of functions |
scientific article |
Statements
Vapnik-Chervonenkis type conditions and uniform Donsker classes of functions (English)
0 references
10 June 2004
0 references
Let \({\mathcal F}\) be a class of functions defined on a measurable space \(\Omega\). We say that a class of \({\mathcal F}\) of functions \(\varepsilon\)-shatters a set \(F\) if for some point \(x\) in \(F\) there exists a level \(\alpha(x)\in\mathbb{R}\) such that, given any subset \(G\) of \(F\), we can find a function \(f\) in \({\mathcal F}\), such that \(f(x)\leq\alpha(x)\) for \(x\in G\), while \(f(x)\geq \alpha(x)+\varepsilon\) for \(x\) in \(F- G\). We define the shattering function \(S_{\mathcal F}(\varepsilon)\) of \({\mathcal F}\) by \(S_{\mathcal F}(\varepsilon)= \sup\{n:{\mathcal F}\;\varepsilon\text{-shatters a set of cardinality }n\}.\) Let \(D(\varepsilon,{\mathcal F})\) be the Koltchinskii-Pollard capacity. The author proves among others the following: If \({\mathcal F}\) is uniformly bounded and \(\xi\) is some continuous positive nonincreasing function on \((0,\infty)\) such that for each \(\varepsilon> 0\), \(S_{\mathcal F}(\varepsilon)\leq \xi(\varepsilon)\), then \[ \forall\varepsilon< \Delta\quad \log D(\varepsilon,{\mathcal F})\leq \xi(\varepsilon)\log (4\Delta/\varepsilon)^K, \] where \(\Delta\) is the diameter of \({\mathcal F}\) for the uniform norm and \(K\) depends on \(\alpha\) only [cf. the author, ibid. 15, 837--870 (1987; Zbl 0632.60024)]. Combining this with the easy fact that \(S_{\mathcal F}(\varepsilon)\leq \log D(\varepsilon/2,{\mathcal F})\) we see that \(S_{\mathcal F}(\varepsilon)\approx\log D(\varepsilon,{\mathcal F})\) (within log terms). As a corollary, the author establishes that there exists a universal constant \(M\) such that a countable uniformly bounded class \({\mathcal F}\) that satisfies \[ \sup_{\varepsilon}\,\varepsilon^2 S_{\mathcal F}(\varepsilon)(\log(4\Delta/\varepsilon))^M< \infty \] is a uniform Donsker class.
0 references
shattering
0 references
combinatorial dimension
0 references
Donsker classes
0 references