Rates of convergence for random forests via generalized U-statistics

DOI10.1214/21-EJS1958zbMath1493.62071arXiv1905.10651OpenAlexW4206811903MaRDI QIDQ2136608

Wei Peng, Tim Coleman, Lucas K. Mentch

Publication date: 11 May 2022

Published in: Electronic Journal of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1905.10651

zbMATH Keywords

U-statisticsrandom forestsCARTbaggingBerry-Esseen

Mathematics Subject Classification ID

Asymptotic distribution theory in statistics (62E20) Central limit and other weak theorems (60F05) Approximations to statistical distributions (nonasymptotic) (62E17)

Related Items (4)

Quantifying uncertainty of subsampling-based ensemble methods under a U-statistic framework ⋮ On the variable bandwidth kernel estimation of conditional \(U\)-statistics at optimal rates in sup-norm ⋮ Renewal type bootstrap for increasing degree \(U\)-process of a Markov chain ⋮ Uniform consistency and uniform in number of neighbors consistency for nonparametric regression estimates and conditional \(U\)-statistics involving functional data

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Bagging predictors
• Random survival forests
• On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification
• Lectures on the nearest neighbor method
• Consistency of random survival forests
• Confidence sets for split points in decision trees
• The jackknife estimate of variance
• Convergence rates for U-statistics and related statistics
• On the Berry-Esseen theorem for U-statistics
• The Berry-Esseen theorem for U-statistics
• The collected works of Wassily Hoeffding. Ed. by N. I. Fisher and P. K. Sen
• Normal approximation under local dependence.
• Approximating high-dimensional infinite-order \(U\)-statistics: statistical and computational guarantees
• Randomized incomplete \(U\)-statistics in high dimensions
• Estimating a sharp convergence bound for randomized ensembles
• The effect of splitting on random forests
• Central limit theorems and bootstrap in high dimensions
• Consistency of random forests
• A random forest guided tour
• Random Forests and Kernel Methods
• Normal Approximation by Stein’s Method
• Asymptotic Statistics
• Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
• Estimation and Accuracy After Model Selection
• CLT For U-statistics With Growing Dimension
• Reinforcement Learning Trees
• Random Forests and Adaptive Nearest Neighbors
• The Accuracy of the Gaussian Approximation to the Sum of Independent Variates
• A Class of Statistics with Asymptotically Normal Distribution
• The Theory of Unbiased Estimation
• A non-uniform Berry-Esseen bound via Stein's method
• Random forests

This page was built for publication: Rates of convergence for random forests via generalized U-statistics