New concentration inequalities in product spaces
We consider that this paper is particularly rich in results, methods, comments explaining the results, outlines of history, accompanied by quotation of expository papers. In order not to increase the length of the review (author's abstract would be a too short one), we present only the results entitled as theorems. Let \((\Omega,\mu)\) be a probability space, \(P= \mu\otimes^n A\), \(A\subset\Omega^n\), and \(\nu\) be probabilities on \(\Omega^n\). If \(x= (x_i)\), \(y=(y_i)\in\Omega^n\), we define \(h_i(x, y)\) as 1 for \(x_i\neq y_i\) and 0 for \(x_i= y_i\). The first result (1.1) is \(\int e(A)dP\leq 1/P(A)\), where \(e(A, x)= \inf_{\nu(A)= 1}e(\nu, x)\), \(e(\nu, x)= \int c(y_1,y_2)d\nu(y_1) d\nu(y_2)\), \(c(y_1, y_2)= (5/4)^s\), \(s= \sum_i h_i(x, y_1) h_i(x, y_2)\). This result is deduced in Section 2, for \(\beta= 1/2\), from (2.1) stating the same inequality with the right member at the power \(2\beta^2/(1- 2\beta^2)\), \(\beta^2< 1/2\), where now \(e(\nu, x)= \int(\int \prod_i(1+ \beta h_i(x, y)\varepsilon_i) d\nu(y))^2 dP(\varepsilon)\), \(\Omega= \{\pm 1\}\) and \(\mu\) is the ``uniform one. The second result (1.2), with \(\Omega\), \(\mu\) as in (2.1), consists in the existence of a universal constant \(K\) such that \(P(| Z-M|\geq t)\leq 2\exp(-\min(t^2/V^2,t/U)/K)\), where \(M\) is a median of \(Z\), \(Z(\varepsilon)= \|\sum_{i,j} x_{ij}\varepsilon_i\varepsilon_j\|\), \(x_{ij}= x_{ji}\) are elements of a Banach space \(W\), \(x_{ii}= 0\), \(U= \sup \sum_{i,j}\alpha_i \gamma_jx^*(x_{ij})\) over all \(\alpha\), \(\gamma\) with \(\|\cdot\|_2\leq 1\) and \(x^*\in W^*\) with \(\| x^*\|\leq 1\), \(V= E(\sup_{x^*} (\sum_j(\sum_i \varepsilon_ix^*(x_{ij}))^2))\). In Theorem (1.3) we have \(n^2\) instead of \(n\), \(\Omega= \{0,1\}\), \(\mu\) is also uniform and \(x\), \(y\) are considered as \(n\times n\) matrices, \(d(x,y)\) being the operator norm of \(x-y\) when acting on \(\ell^2_n\). It states that \(P(d(A)\geq K_1 n^{1/4}(\log n)^{5/4})\leq 1/n^2\), for \(P(A)\geq 1/2\). In its proof (3.1) is used, establishing that for some \(L\), for every \(A\subset\{0,1\}^n\), \(x\in\{0, 1\}^n\) there exists a probability \(\nu\) on \(A\) and a \(p(x)\) such that for all \(\alpha_i\leq 1\), we have \[ \int\exp\Biggl(\Biggl(\sum_i \alpha_i h_i(x, y)\Biggr) \Biggl/ L\Biggr)d\nu(y)\leq \exp(\|\alpha\|_2(p(x)+ \log^{1/2}(en))) \] and also \(\int\exp(p(x)^2)dP(x)\leq 1/P(A)\). (1.4) says that \[ P(| Z-EZ|\geq t)\leq K\exp(-t(KU)^{-1}\log(1+ tUV^{-1})), \] where \(Z(x)= \sup_k\sum_i f_k(x_i)\), \(f_k\), \(k=1,2,\dots\), are measurable on \(\Omega\), \(U= \sup_k\| f_k\|_\infty\), \(V= E_\mu(\sup_k \sum_i f(x_i)^2)\). It uses (4.2): \(\int\exp(m(A)/L)dP\leq 1/P(A)\), where \(\Omega\) is finite, \(m(A,x)= \inf_{\nu(A)= 1}m(\nu, x)\), \(m(\nu, x)= \sum_i\psi(d_i)d\mu\), \(\psi(x)= \tau x^2\), \(\tau= (\log 2)/2\) for \(x\leq 2\), \(\psi(x)= x\log x\) for \(x\geq 2\), \(d_i= d\nu_i/d\mu\), \(\nu_i\) is the image by \(y\to y_i\) of the restriction of \(\nu\) to \(\{y; y_i\neq x_i\}\). (5.1): \(\int G_q(A)dP\leq 1/P(A)^q\), where \(G_q(A, x)= \inf_{\nu(A)= 1}G(\nu,\dots, \nu,x)\), \(\nu\) atomic, \[ G(\nu_1,\dots, \nu_q,x)= \int(a(q)+ 1)^{U(y_1,\dots,y_q;x)}d\nu_1(y_1)\cdots d\nu_q(y_q), \] \(a(q)= (1+ qt_q)^q/(1+ q)^{q-1}\) and \(t_q\) is the largest root of \((1-t)(1+ tq)^q= (1+ t(q+1))^{q-1}\). (5.4): \(\int\exp(\tau V(A_1,\dots, A_q)/q)dP\leq \prod_r P(A_r)^{-1/q}\), \(V(A_1,\dots, A_q; x)= \inf_{y_r\in A_r}V(y_1,\dots, y_q;\;x)\), \(V(y_1,\dots, y_q; x)= \text{card}\{i; \sum_r h_i(x,y_r)\geq 2\}\). Also (6.2): in (2.1) one may choose \(\beta\) such that \(\int (e(A)- 1)dP\leq (1- P(A))P(A)^{-1}(\log(e/(1- P(A))))^{-1}\) for all \(n\) and \(A\).
- An exponential inequality for the distribution function of the kernel density estimator, with applications to adaptive estimation
- Adaptation on the space of finite signed measures
- Central and \(L^p\)-concentration of 1-Lipschitz maps into \(R\)-trees
- Localization near fluctuation boundaries via fractional moments and applications
- Instability, complexity, and evolution
- Generalization performance of graph-based semi-supervised classification
- Information inequalities and concentration of measure
- Concentration inequalities using the entropy method
- Symmetrization approach to concentration inequalities for empirical processes.
- Direct importance estimation for covariate shift adaptation
- Laws of the iterated logarithm for censored data
- A Bennett concentration inequality and its application to suprema of empirical processes
- Left concentration inequalities for empirical processes
- Laws of large numbers and tail inequalities for random tries and PATRICIA trees
- Moderate deviations and nonparametric inference for monotone functions
- Fast learning rate of non-sparse multiple kernel learning and optimal regularization strategies
- Moderate deviations for estimators under exponentially stochastic differentiability conditions
- Adaptive confidence sets for matrix completion
- Gaussian and bootstrap approximations for high-dimensional U-statistics and their applications
- Moment inequalities for functions of independent random variables
- Concentration around the mean for maxima of empirical processes
- Central limit theorems for the Wasserstein distance between the empirical and the true distributions
- Variance of Lipschitz functions and an isoperimetric problem for a class of product measures
- Expected worst-case partial match in random quadtries
- Adaptive estimation in autoregression or \(\beta\)-mixing regression via model selection
- About the constants in Talagrand's concentration inequalities for empirical processes.
- The LIL for canonical \(U\)-statistics of order 2
- Isoperimetry for Gibbs measures
- Concentration inequalities, large and moderate deviations for self-normalized empirical processes
- Bounding the generalization error of convex combinations of classifiers: Balancing the dimensionality and the margins.
- Concentration of measure inequalities for Markov chains and \(\Phi\)-mixing processes.
- Measure concentration for Euclidean distance in the case of dependent random variables.
- Weighted uniform consistency of kernel density estimators.
- Concentration of measure and isoperimetric inequalities in product spaces
- A new look at independence
- Cumulative distribution function estimation under interval censoring case 1
- Properties of the parabolic Anderson model and the Anderson polymer model
- Large deviations and moderate deviations for kernel density estimators of directional data
- On Bernstein type inequalities for stochastic integrals of multivariate point processes
- A semi-parametric mode regression with censored data
- Quadratic transportation cost inequality for scalar stochastic conservation laws
- Concentration inequalities for bounded functionals via log-Sobolev-type inequalities
- Applications of weak transport theory
- Modified log-Sobolev inequalities, Beckner inequalities and moment estimates
- Concentration inequalities for suprema of unbounded empirical processes
- Functional linear regression with Huber loss
- Stability of martingale optimal transport and weak optimal transport
- Berry-Esseen bounds for Chernoff-type nonstandard asymptotics in isotonic regression
- Anisotropic spectral cut-off estimation under multiplicative measurement errors
- Convergence rates for empirical barycenters in metric spaces: curvature, convexity and extendable geodesics
- Weak monotone rearrangement on the line
- Uniform Hanson-Wright type concentration inequalities for unbounded entries via the entropy method
- Learning rates for partially linear functional models with high dimensional scalar covariates
- Model selection: from theory to practice
- Uniform convergence rates for wavelet curve estimation in sup-norm loss
- Exponential inequalities for the supremum of some counting processes and their square martingales
- Optimal adaptive estimation on \(\mathbb{R}\) or \(\mathbb{R}^{+}\) of the derivatives of a density
- A lower bound for the discrepancy of a random point set
- On the errors committed by sequences of estimator functionals
- About the rate function in concentration inequalities for suprema of bounded empirical processes
- Second order concentration via logarithmic Sobolev inequalities
- Talagrand concentration inequalities for stochastic heat-type equations under uniform distance
- Talagrand concentration inequalities for stochastic partial differential equations
- Relative error prediction for twice censored data
- Inference on covariance operators via concentration inequalities: \(k\)-sample tests, classification, and clustering via Rademacher complexities
- An exponential inequality for suprema of empirical processes with heavy tails on the left
- Nonparametric estimation of low rank matrix valued function
- Isotonic regression in general dimensions
- Existence, duality, and cyclical monotonicity for weak transport costs
- Nonparametric robust regression estimation for censored data
- Local Rademacher complexities and oracle inequalities in risk minimization. (2004 IMS Medallion Lecture). (With discussions and rejoinder)
- Confidence bands in density estimation
- Convergence of the optimal M-estimator over a parametric family of M-estimators
- Kantorovich duality for general transport costs and applications
- Ranking and empirical minimization of \(U\)-statistics
- Global uniform risk bounds for wavelet deconvolution estimators
- Adaptive circular deconvolution by model selection under unknown error distribution
- Empirical risk minimization is optimal for the convex aggregation problem
- Adaptive estimation in circular functional linear models
- Histogram selection for possibly censored data
- On the Bennett-Hoeffding inequality
- Quasi-Bayesian analysis of nonparametric instrumental variables models
- Estimation of the density of regression errors by pointwise model selection
- Adaptive density estimation of stationary \(\beta\)-mixing and \(\tau\)-mixing processes
- Confidence sets in sparse regression
- Spectral asymptotics of the Laplacian on supercritical bond-percolation graphs
- Local tail bounds for functions of independent random variables
- Super optimal rates for nonparametric density estimation via projection estimators
- Concentration inequalities and asymptotic results for ratio type empirical processes
- Compensator and exponential inequalities for some suprema of counting processes
- Tail bounds for the supremums of empirical processes over unbounded classes of functions
- Some asymptotic properties for a smooth kernel estimator of the conditional mode under random censorship
- Fast and RIP-optimal transforms
- Bandwidth selection in kernel empirical risk minimization via the gradient
- Concentration inequalities for dependent random variables via the martingale method
- Adaptive estimation of the baseline hazard function in the Cox model by model selection, with high-dimensional covariates
- Ergodic theorems for some classical problems in combinatorial optimization
- A note on concentration for polynomials in the Ising model
- Rigorous verification, validation, uncertainty quantification and certification through concentration-of-measure inequalities
- Exact matrix completion via convex optimization
This page was built for publication: New concentration inequalities in product spaces
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5961446)