A random forest guided tour

DOI10.1007/s11749-016-0481-7zbMath1402.62133arXiv1511.05741OpenAlexW2216946510MaRDI QIDQ2629364

Gérard Biau, Erwan Scornet

Publication date: 6 July 2016

Published in: Test (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1511.05741

zbMATH Keywords

classificationresamplingrandomizationregressionrandom forestsparameter tuningvariable importance

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Nonparametric statistical resampling methods (62G09) Learning and adaptive systems in artificial intelligence (68T05) Graph theory (including graph drawing) in computer science (68R10) Research exposition (monographs, survey articles) pertaining to statistics (62-02)

Related Items (54)

The Impact of Churn on Client Value in Health Insurance, Evaluation Using a Random Forest Under Various Censoring Mechanisms ⋮ Mathematical optimization in classification and regression trees ⋮ On the use of random forest for two-sample testing ⋮ A Comparative Study on Machine Learning Techniques for Intense Convective Rainfall Events Forecasting ⋮ Rates of convergence for random forests via generalized U-statistics ⋮ Comments on: ``A random forest guided tour ⋮ Variable selection in time series forecasting using random forests ⋮ Dimension Reduction Forests: Local Variable Importance Using Structured Random Forests ⋮ ESG score prediction through random forest algorithm ⋮ Stochastic Geometry to Generalize the Mondrian Process ⋮ Optimal functional supervised classification with separation condition ⋮ Consistency of survival tree and forest models: splitting bias and correction ⋮ A random forest based approach for predicting spreads in the primary catastrophe bond market ⋮ Optimal randomized classification trees ⋮ On sparse optimal regression trees ⋮ Joint leaf-refinement and ensemble pruning through \(L_1\) regularization ⋮ Quantum amplitude amplification algorithm simulation for prediction of a binary classification problem ⋮ Regression with missing data, a comparison study of techniques based on random forests ⋮ Smoothing and adaptation of shifted Pólya tree ensembles ⋮ A \(k\)-additive Choquet integral-based approach to approximate the SHAP values for local interpretability in machine learning ⋮ Explainable subgradient tree boosting for prescriptive analytics in operations management ⋮ HETEROGENEOUS TREATMENT EFFECTS OF NUDGE AND REBATE: CAUSAL MACHINE LEARNING IN A FIELD EXPERIMENT ON ELECTRICITY CONSERVATION ⋮ Using machine learning prediction models for quality control: a case study from the automotive industry ⋮ Separating the signal from the noise -- financial machine learning for Twitter ⋮ A phase transition for the probability of being a maximum among random vectors with general iid coordinates ⋮ Unnamed Item ⋮ Random Forest Prediction Intervals ⋮ Random forests in count data modelling: an analysis of the influence of data features and overdispersion on regression performance ⋮ Model selection uncertainty and stability in beta regression models: a study of bootstrap-based model averaging with an empirical application to clickstream data ⋮ Collaborative Multilabel Classification ⋮ Model-Assisted Estimation Through Random Forests in Finite Population Sampling ⋮ Predicting the spatial distribution of stable isotopes in precipitation using a machine learning approach: a comparative assessment of random forest variants ⋮ Sports analytics in the NFL: classifying the winner of the superbowl ⋮ Cost-based Feature Selection for Network Model Choice ⋮ Tuning parameters in random forests ⋮ Modeling of time series using random forests: theoretical developments ⋮ Posterior concentration for Bayesian regression trees and forests ⋮ Minimax optimal rates for Mondrian trees and forests ⋮ Quantum Markovianity as a supervised learning task ⋮ Random forests for time-dependent processes ⋮ Optimization of Tree Ensembles ⋮ Generalized random forests ⋮ Predictive Distribution Modeling Using Transformation Forests ⋮ Distributional regression forests for probabilistic precipitation forecasting in complex terrain ⋮ Neural random forests ⋮ Sparsity in optimal randomized classification trees ⋮ Unnamed Item ⋮ Towards convergence rate analysis of random forests for classification ⋮ Models under which random forests perform badly; consequences for applications ⋮ A surrogate model for estimating extreme tower loads on wind turbines based on random forest proximities ⋮ Variable selection and importance in presence of high collinearity: an application to the prediction of lean body mass from multi-frequency bioelectrical impedance ⋮ Optional Pólya trees: posterior rates and uncertainty quantification ⋮ Assessing Spillover Effects of Spatial Policies with Semiparametric Zero-Inflated Models and Random Forests ⋮ Asymptotic properties of high-dimensional random forests

Uses Software

• yaImpute
• GeneSrF
• AppliedPredictiveModeling
• randomForest
• obliqueRF

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Correlation and variable importance in random forests
• Bagging predictors
• Random survival forests
• On the asymptotics of random forests
• Cellular tree classifiers
• On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification
• Robust \(H_{\infty }\) control for nonlinear uncertain stochastic T-S fuzzy systems with time delays
• Consistency of random survival forests
• Confidence sets for split points in decision trees
• Empirical characterization of random forest variable importance measures
• Optimal rates of convergence for nonparametric estimators
• Consistent nonparametric regression. Discussion
• Bootstrap methods: another look at the jackknife
• Subsampling
• Randomizing outputs to increase prediction accuracy
• Cluster forests
• Optimal global rates of convergence for nonparametric regression
• A distribution-free theory of nonparametric regression
• Analyzing bagging
• Forest Garrote
• The effect of splitting on random forests
• Variable importance in binary regression trees and forests
• Consistency of random forests
• Comments on: ``A random forest guided tour
• A weighted random forests approach to improve predictive performance
• Applied Predictive Modeling
• Probability estimation with machine learning methods for dichotomous and multicategory outcome: Theory
• Probability estimation with machine learning methods for dichotomous and multicategory outcome: Applications
• Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning
• Random Forests and Kernel Methods
• Variance reduction in purely random forests
• Learning Deep Architectures for AI
• Regression Trees for Censored Data
• Adaptive Estimation of the Optimal ROC Curve and a Bipartite Ranking Algorithm
• On the Distribution of the Number of Admissible Points in a Vector Random Sample
• Random survival forests for high‐dimensional data
• A Scalable Bootstrap for Massive Data
• Reinforcement Learning Trees
• Maxima in hypercubes
• Random Forests and Adaptive Nearest Neighbors
• Extremely randomized trees
• Random forests
• Gene selection for cancer classification using support vector machines

This page was built for publication: A random forest guided tour