Gaussian approximation of suprema of empirical processes
From MaRDI portal
Abstract: This paper develops a new direct approach to approximating suprema of general empirical processes by a sequence of suprema of Gaussian processes, without taking the route of approximating whole empirical processes in the sup-norm. We prove an abstract approximation theorem applicable to a wide variety of statistical problems, such as construction of uniform confidence bands for functions. Notably, the bound in the main approximation theorem is nonasymptotic and the theorem allows for functions that index the empirical process to be unbounded and have entropy divergent with the sample size. The proof of the approximation theorem builds on a new coupling inequality for maxima of sums of random vectors, the proof of which depends on an effective use of Stein's method for normal approximation, and some new empirical process techniques. We study applications of this approximation theorem to local and series empirical processes arising in nonparametric estimation via kernel and series methods, where the classes of functions change with the sample size and are non-Donsker. Importantly, our new technique is able to prove the Gaussian approximation for the supremum type statistics under weak regularity conditions, especially concerning the bandwidth and the number of series functions, in those examples.
Recommendations
- Gaussian approximation of local empirical processes indexed by functions
- About conditions of Gaussian approximation of kernel estimates for distribution density
- Empirical and multiplier bootstraps for suprema of empirical processes of increasing complexity, and related Gaussian couplings
- On convergence rates of suprema
- Gaussian approximation of the empirical process under random entropy conditions
Cites work
- A local maximal inequality under uniform entropy
- A refinement of the KMT inequality for the uniform empirical process
- A uniform functional law of the logarithm for the local empirical process.
- A user's guide to measure theoretic probability
- An approximation of partial sums of independent RV'-s, and the sample DF. I
- An empirical process approach to the uniform consistency of kernel-type function estimators
- Anti-concentration and honest, adaptive confidence bands
- Asymptotics for polynomial spline regression under weak conditions.
- Comparison and anti-concentration bounds for maxima of Gaussian random vectors
- Concentration inequalities and confidence bands for needlet density estimators on compact homogeneous manifolds
- Concentration inequalities. A nonasymptotic theory of independence
- Confidence bands in density estimation
- Convergence rates and asymptotic normality for series estimators
- Functional laws of the iterated logarithm for local empirical processes indexed by sets
- Gaussian approximation of local empirical processes indexed by functions
- Gaussian approximation of suprema of empirical processes
- Gaussian approximation of the empirical process under random entropy conditions
- Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors
- Global uniform risk bounds for wavelet deconvolution estimators
- scientific article; zbMATH DE number 49190 (Why is no real title available?)
- scientific article; zbMATH DE number 50805 (Why is no real title available?)
- scientific article; zbMATH DE number 1149760 (Why is no real title available?)
- scientific article; zbMATH DE number 3438144 (Why is no real title available?)
- scientific article; zbMATH DE number 3008134 (Why is no real title available?)
- scientific article; zbMATH DE number 272681 (Why is no real title available?)
- Hungarian constructions from the nonasymptotic viewpoint
- Intersection bounds: estimation and inference
- Invariance principles for sums of Banach space valued random elements and empirical processes
- Komlós-Major-Tusnády approximation for the general empirical process and Haar expansions of classes of functions
- Limit theorems for sums of weakly dependent Banach space valued random variables
- Local invariance principles and their application to density estimation
- Moment inequalities for functions of independent random variables
- Multiscale methods for shape constraints in deconvolution: confidence statements for qualitative features
- Multivariate normal approximation using exchangeable pairs
- Multivariate normal approximation with Stein's method of exchangeable pairs under a general linearity condition
- New concentration inequalities in product spaces
- Normal Approximation by Stein’s Method
- On consistency of kernel density estimators for randomly censored data: Rates holding uniformly over adaptive intervals
- On some global measures of the deviations of density function estimates
- On Stein's method for multivariate normal approximation
- On the convergence rate of maximal deviation distribution for kernel regression estimates
- On the Error of the Gaussian Approximation for Convolutions
- On the Gaussian approximation of convolutions under multidimensional analogues of S. N. Bernstein's inequality conditions
- Projection estimation in multiple regression with application to functional ANOVA models
- Rate of convergence in the central limit theorem for empirical processes
- Rates of strong uniform consistency for multivariate kernel density estimators. (Vitesse de convergence uniforme presque sûre pour des estimateurs à noyaux de densités multivariées)
- Revisiting two strong approximation results of Dudley and Philipp
- Stochastic convergence of persistence landscapes and silhouettes
- Strong approximation for multivariate empirical and related processes, via KMT constructions
- Strong approximation of density estimators from weakly dependent observations by density estimators from independent observations
- Testing monotonicity of regression.
- The Generic Chaining
- The Sherrington-Kirkpatrick model
- U-processes: Rates of convergence
- Uniform Central Limit Theorems
- Uniform in bandwidth consistency of kernel-type function estimators
- Uniform limit theorems for wavelet density estimators
- Wavelets on the interval and fast wavelet transforms
- Weak convergence and empirical processes. With applications to statistics
Cited in
(only showing first 100 items - show all)- Gaussian approximation of the empirical process under random entropy conditions
- Large Sample Properties of Partitioning-Based Series Estimators
- A unified theory of confidence regions and testing for high-dimensional estimating equations
- Are discoveries spurious? Distributions of maximum spurious correlations and their applications
- About tests of the ``simplifying assumption for conditional copulas
- Locally adaptive confidence bands
- Uniform confidence bands in deconvolution with unknown error distribution
- Multiscale scanning in inverse problems
- Uniformly valid post-regularization confidence regions for many functional parameters in z-estimation framework
- Extremes of locally stationary Gaussian and chi fields on manifolds
- Inference for first-price auctions with Guerre, Perrigne, and Vuong's estimator
- Robust uniform inference for quantile treatment effects in regression discontinuity designs
- Nonparametric inference via bootstrapping the debiased estimator
- Necessary and sufficient conditions for variable selection consistency of the Lasso in high dimensions
- Empirical process results for exchangeable arrays
- Asymptotic confidence regions for density ridges
- Volatility coupling
- Concentration inequalities for suprema of unbounded empirical processes
- On linearization of nonparametric deconvolution estimators for repeated measurements model
- Space partitioning and regression maxima seeking via a mean-shift-inspired algorithm
- Stratified incomplete local simplex tests for curvature of nonparametric multiple regression
- Bootstrapping the operator norm in high dimensions: error estimation for covariance matrices and sketching
- High-dimensional linear models with many endogenous variables
- Berry-Esseen bounds for Chernoff-type nonstandard asymptotics in isotonic regression
- Jackknife multiplier bootstrap: finite sample approximations to the \(U\)-process supremum with applications
- Trinity tests of functions for conditional moment models
- Multidimensional multiscale scanning in exponential families: limit theory and statistical consequences
- High-dimensional CLT: improvements, non-uniform extensions and large deviations
- Uniform nonparametric inference for time series
- Pivotal estimation via square-root lasso in nonparametric regression
- Uniform confidence bands for nonparametric errors-in-variables regression
- Gaussian approximations for maxima of random vectors under \((2+\iota)\)-th moments
- Bootstrap confidence bands for spectral estimation of Lévy densities under high-frequency observations
- Nonparametric inference on Lévy measures of compound Poisson-driven Ornstein-Uhlenbeck processes under macroscopic discrete observations
- Approximation to stable law by the Lindeberg principle
- Quantile regression approach to conditional mode estimation
- Non-separable models with high-dimensional data
- Gaussian approximation of maxima of Wiener functionals and its application to high-frequency data
- Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors
- Bootstrap adjusted predictive classification for identification of subgroups with differential treatment effects under generalized linear models
- Nonparametric modal regression
- V.N. Sudakov’s Work on Expected Suprema of Gaussian Processes
- A massive data framework for M-estimators with cubic-rate
- Empirical and multiplier bootstraps for suprema of empirical processes of increasing complexity, and related Gaussian couplings
- Post-regularization inference for time-varying nonparanormal graphical models
- A bootstrap method for error estimation in randomized matrix multiplication
- Gaussian approximation of suprema of empirical processes
- Some new asymptotic theory for least squares series: pointwise and uniform results
- Inference in nonparametric series estimation with specification searches for the number of series terms
- Hypothesis testing in large-scale functional linear regression
- The hazard level set
- scientific article; zbMATH DE number 7626800 (Why is no real title available?)
- scientific article; zbMATH DE number 7626801 (Why is no real title available?)
- Estimation and inference for moments of ratios with robustness against large trimming bias
- Nonparametric significance testing in measurement error models
- Honest confidence sets in nonparametric IV regression and other ill-posed models
- Optimal Gaussian approximation for multiple time series
- Comment on “A Tuning-Free Robust and Efficient Approach to High-Dimensional Regression”
- Kernel meets sieve: post-regularization confidence bands for sparse additive model
- Monotonicity-constrained nonparametric estimation and inference for first-price auctions
- High-dimensional central limit theorems for homogeneous sums
- Estimating and inferring the maximum degree of stimulus‐locked time‐varying brain connectivity networks
- Unconditional quantile regression with high‐dimensional data
- Inference on heterogeneous treatment effects in high‐dimensional dynamic panels under weak dependence
- On semiparametric inference for periodically modulated density functions
- Inference for High-Dimensional Exchangeable Arrays
- Bootstrap Adjustment to Minimum p-Value Method for Predictive Classification
- A probability approximation framework: Markov process approach
- Nearly optimal central limit theorem and bootstrap approximations in high dimensions
- Bootstrap Inference for Quantile-based Modal Regression
- Testing stochastic dominance with many conditioning variables
- Inference on individual treatment effects in nonseparable triangular models
- Estimation of complier expected shortfall treatment effects with a binary instrumental variable
- Off-Policy Confidence Interval Estimation with Confounded Markov Decision Process
- Estimation and inference for policy relevant treatment effects
- Estimation and inference of treatment effects with L₂-boosting in high-dimensional settings
- Bandwidth selection for nonparametric regression with errors-in-variables
- Communication‐efficient low‐dimensional parameter estimation and inference for high‐dimensional Lp$$ {L}^p $$‐quantile regression
- Local regression distribution estimators
- Statistical inference for nonparametric censored regression
- Proximal Learning for Individualized Treatment Regimes Under Unmeasured Confounding
- Rates of the strong uniform consistency with rates for conditional \(U\)-statistics estimators with general kernels on manifolds
- Boundary adaptive local polynomial conditional density estimators
- Large-dimensional central limit theorem with fourth-moment error bounds on convex sets and balls
- Limit distribution theory for smooth \(p\)-Wasserstein distances
- Confidence bands for survival curves from outcome-dependent stratified samples
- Sharp adaptive and pathwise stable similarity testing for scalar ergodic diffusions
- Estimation of Conditional Average Treatment Effects With High-Dimensional Data
- Transformation Models in High Dimensions
- High-Dimensional Mixed-Frequency IV Regression
- Gaussian Approximation and Spatially Dependent Wild Bootstrap for High-Dimensional Spatial Data
- Testing Directed Acyclic Graph via Structural, Supervised and Generative Adversarial Learning
- Value Enhancement of Reinforcement Learning via Efficient and Robust Trust Region Optimization
- Gaussian approximation of local empirical processes indexed by functions
- Confidence regions for filamentary structures
- On generalized cce estimation
- Estimation and inference for causal functions with multi-way clustered data
- Identification and inference in a quantile regression discontinuity design under rank similarity with covariates
- Quantile graphical models: prediction and conditional independence with applications to systemic risk
- Yurinskii's coupling for martingales
This page was built for publication: Gaussian approximation of suprema of empirical processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q464197)