Empirical characterization of random forest variable importance measures

DOI10.1016/j.csda.2007.08.015zbMath1452.62027OpenAlexW1996031526MaRDI QIDQ1023556

Kellie J. Archer, Ryan V. Kimes

Publication date: 12 June 2009

Published in: Computational Statistics and Data Analysis (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.csda.2007.08.015

zbMATH Keywords

classification treerandom forestvariable importancebootstrap aggregating

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Applications of statistics to biology and medical sciences; meta analysis (62P10) Learning and adaptive systems in artificial intelligence (68T05)

Related Items (22)

A new variable selection approach using random forests ⋮ Variable selection by random forests using data with missing values ⋮ The Delaunay triangulation learner and its ensembles ⋮ A random forest guided tour ⋮ Agent-based model calibration using machine learning surrogates ⋮ Measuring regional effects of model inputs with random Forest ⋮ A new variable importance measure for random forests with missing data ⋮ Breaking the curse of dimensionality in quadratic discriminant analysis models with a novel variant of a Bayes classifier enhances automated taxa identification of freshwater macroinvertebrates ⋮ Consistent and unbiased variable selection under indepedent features using random forest permutation importance ⋮ Automated machine learning can classify bound entangled states with tomograms ⋮ Enterprise credit risk portrait and evaluation from the perspective of the supply chain ⋮ Bayesian additive regression trees using Bayesian model averaging ⋮ All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously ⋮ Correlation and variable importance in random forests ⋮ A similarity measure to assess the stability of classification trees ⋮ Taxonomy for characterizing ensemble methods in classification tasks: a review and annotated bibliography ⋮ Mathematical modeling of ventilator-induced lung inflammation ⋮ Ensemble classification based on generalized additive models ⋮ On Combining Wavelets Expansion and Sparse Linear Models for Regression on Metabolomic Data and Biomarker Selection ⋮ Unrestricted permutation forces extrapolation: variable importance requires at least one more model, or there is no free variable importance ⋮ Sparsity Oriented Importance Learning for High-Dimensional Linear Regression ⋮ Variable selection and importance in presence of high collinearity: an application to the prediction of lean body mass from multi-frequency bioelectrical impedance

Uses Software

• R
• Bioconductor
• gcrma
• Design
• GeneSrF

Cites Work

• Bagging predictors
• A note on split selection bias in classification trees
• Unbiased split selection for classification trees based on the Gini index
• Heuristics of instability and stabilization in model selection
• Attribute bagging: Improving accuracy of classifier ensembles by using random feature subsets.
• Statistical modeling: The two cultures. (With comments and a rejoinder).
• Bioinformatics and computational biology solutions using R and Bioconductor.
• Assessment of Optimal Selected Prognostic Factors
• Random forests
• Estimating generalization error on two-class datasets using out-of-bag estimates
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: Empirical characterization of random forest variable importance measures