Generalized random forests
From MaRDI portal
Nonparametric estimation (62G05) Density estimation (62G07) Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05)
Abstract: We propose generalized random forests, a method for non-parametric statistical estimation based on random forests (Breiman, 2001) that can be used to fit any quantity of interest identified as the solution to a set of local moment equations. Following the literature on local maximum likelihood estimation, our method considers a weighted set of nearby training examples; however, instead of using classical kernel weighting functions that are prone to a strong curse of dimensionality, we use an adaptive weighting function derived from a forest designed to express heterogeneity in the specified quantity of interest. We propose a flexible, computationally efficient algorithm for growing generalized random forests, develop a large sample theory for our method showing that our estimates are consistent and asymptotically Gaussian, and provide an estimator for their asymptotic variance that enables valid confidence intervals. We use our approach to develop new methods for three statistical tasks: non-parametric quantile regression, conditional average partial effect estimation, and heterogeneous treatment effect estimation via instrumental variables. A software implementation, grf for R and C++, is available from CRAN.
Recommendations
Cites work
- scientific article; zbMATH DE number 6378123 (Why is no real title available?)
- scientific article; zbMATH DE number 991833 (Why is no real title available?)
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 3738700 (Why is no real title available?)
- scientific article; zbMATH DE number 3782216 (Why is no real title available?)
- scientific article; zbMATH DE number 1911984 (Why is no real title available?)
- A Class of Statistics with Asymptotically Normal Distribution
- A Unified Approach to Structural Change Tests Based on ML Scores,FStatistics, and OLS Residuals
- A local generalized method of moments estimator
- A random forest guided tour
- Analysis of a random forests model
- Analyzing bagging
- Applied Econometrics with R
- Asymptotic Statistics
- BART: Bayesian additive regression trees
- Bagging predictors
- Comments on: ``A random forest guided tour
- Consistency of random forests
- Consistency of random forests and other averaging classifiers
- Consistency of random survival forests
- Consistent nonparametric regression. Discussion
- Double/debiased machine learning for treatment and structural parameters
- Econometric analysis of cross section and panel data.
- Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
- Extremely randomized trees
- Generalized M‐fluctuation tests for parameter instability
- Generalized random forests
- Greedy function approximation: A gradient boosting machine.
- Identification and Estimation of Local Average Treatment Effects
- Instrumental Variable Estimation of Nonparametric Models
- Local Likelihood Estimation
- Local Maximum Likelihood Estimation and Inference
- Local Regression and Likelihood
- Nonparametric instrumental regression
- On asymptotically efficient estimation in semiparametric models
- On the layered nearest neighbour estimate, the bagged nearest neighbour estimate and the random forest method in regression and classification
- Panel Data Discrete Choice Models with Lagged Dependent Variables
- Quantifying uncertainty in random forests via confidence intervals and hypothesis tests
- Quantile regression forests
- Random Forests and Adaptive Nearest Neighbors
- Random forests
- Recursive partitioning for heterogeneous causal effects
- Reinforcement learning trees
- Root-N-Consistent Semiparametric Regression
- Semiparametric instrumental variable estimation of treatment response models.
- Some Comments on C P
- Sparse models and methods for optimal instruments with an application to eminent domain
- Standard errors for bagged and random forest estimators
- Testing for the Constancy of Parameters Over Time
- Tests For Constancy Of Model Parameters Over Time
- Tests for Parameter Instability and Structural Change With Unknown Change Point
- The Asymptotic Variance of Semiparametric Estimators
- The Cusum Test with Ols Residuals
- The Influence Curve and Its Role in Robust Estimation
- The Kernel Estimate of a Regression Function in Likelihood-Based Models
- The central role of the propensity score in observational studies for causal effects
- The jackknife estimate of variance
- Tree-based multivariate regression and density estimation with right-censored data
Cited in
(only showing first 100 items - show all)- Some novel aspects of quantile regression: local stationarity, random forests, and optimal transportation
- Semiparametric inference based on adaptively collected data
- Local Linear Forests
- Doubly-Valid/Doubly-Sharp Sensitivity Analysis for Causal Inference with Unmeasured Confounding
- SETAR-Tree: a novel and accurate tree algorithm for global time series forecasting
- To do or not to do? Cost-sensitive causal classification with individual treatment effect estimates
- Improving uplift model evaluation on randomized controlled trial data
- Semiparametric estimation for average causal effects using propensity score-based spline
- Comment: Invariance and causal inference
- A bootstrap procedure to estimate the causal effect of a public policy, considering overlap and imperfect compliance
- Rates of convergence for random forests via generalized U-statistics
- A Pliable Lasso
- Robust inference of conditional average treatment effects using dimension reduction
- Minimax optimal rates for Mondrian trees and forests
- A reluctant additive model framework for interpretable nonlinear individualized treatment rules
- Response transformation and profit decomposition for revenue uplift modeling
- Overlap violations in external validity: application to Ugandan cash transfer programs
- Heterogeneous treatment and spillover effects under clustered network interference
- So many choices: a guide to selecting among methods to adjust for observed confounders
- The value added of machine learning to causal inference: evidence from revisited studies
- How do firms' financial conditions influence the transmission of monetary policy? A non-parametric local projection approach
- Machine learning who to nudge: causal vs predictive targeting in a field experiment on student financial aid renewal
- Quantile control via random forest
- Asymptotic properties of high-dimensional random forests
- Orthogonal statistical learning
- Semi-Supervised Triply Robust Inductive Transfer Learning
- Approximation error from discretizations and its applications
- Methods for integrating trials and non-experimental data to examine treatment effect heterogeneity
- Quantile regression forests
- Generalized mixed-effects random forest: a flexible approach to predict university student dropout
- Heteroscedasticity-aware stratified sampling to improve uplift modeling
- A survey of contextual optimization methods for decision-making under uncertainty
- Heterogeneous treatment effect-based random forest: HTERF
- Efficient and robust transfer learning of optimal individualized treatment regimes with right-censored survival data
- Ordered correlation forest
- De-biased two-sample U-statistics with application to conditional distribution testing
- Instrument Validity Tests With Causal Forests
- A conditional linear combination test with many weak instruments
- Optimal Nonparametric Inference with Two-Scale Distributional Nearest Neighbors
- Distributional regression forests for probabilistic precipitation forecasting in complex terrain
- Modeling extreme events: univariate and multivariate data-driven approaches. EVA (2023) Conference Data Challenge: team genEVA
- Transformation boosting machines
- Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects (with discussion)
- Distribution-Free Prediction Intervals Under Covariate Shift, With an Application to Causal Inference
- Evaluating Treatment Prioritization Rules via Rank-Weighted Average Treatment Effects
- A semiparametric instrumental variable approach to optimal treatment regimes under endogeneity
- scientific article; zbMATH DE number 7626802 (Why is no real title available?)
- Gradient boosting for extreme quantile regression
- Ensemble projection pursuit for general nonparametric regression
- Towards understanding the instrumental variables methods in biometrics and econometrics
- Recent advances in statistical methodologies in evaluating program for high-dimensional data
- Learning causal effect using machine learning with application to China's typhoon
- ROC‐guided survival trees and ensembles
- Attention-based random forest and contamination model
- Discussion of Kallus (2020) and Mo, Qi, and Liu (2020): New Objectives for Policy Learning
- Nonparametric C- and D-vine-based quantile regression
- Random forests for survival data: which methods work best and under what conditions?
- Predictive Distribution Modeling Using Transformation Forests
- Robust nonparametric regression: a review
- scientific article; zbMATH DE number 7370548 (Why is no real title available?)
- Survival tree averaging by functional martingale-based residuals
- Manifold Oblique Random Forests: Towards Closing the Gap on Convolutional Deep Networks
- Sufficient dimension reduction for average causal effect estimation
- Two-stage least squares random forests with an application to Angrist and Evans (1998)
- Statistical inference of optimal allocations. I: Regularities and their implications
- Estimation and validation of ratio-based conditional average treatment effects using observational data
- Causal Machine Learning for Moderation Effects
- Double Debiased Machine Learning Nonparametric Inference with Continuous Treatments
- A review of recent advances in high-dimensional quantile regression
- Nonunitarizable Representations and Random Forests
- Robust estimation of heterogeneous treatment effects: an algorithm-based approach
- The Effect of Job Loss and Unemployment Insurance on Crime in Brazil
- Forward variable selection for random forest models
- Sharp Sensitivity Analysis for Inverse Propensity Weighting via Quantile Balancing
- Qini Curves for Multi-Armed Treatment Rules
- grf
- Learning optimal biomarker-guided treatment policy for chronic disorders
- Ranking of average treatment effects with generalized random forests for time-to-event outcomes
- Text Selection
- Comparison of methods that combine multiple randomized trials to estimate heterogeneous treatment effects
- Exploratory subgroup identification in the heterogeneous Cox model: a relatively simple procedure
- Learning and confirming a class of treatment responders in clinical trials
- Model-free selective inference under covariate shift via weighted conformal p-values
- Detecting heterogeneous treatment effects with instrumental variables and application to the Oregon Health Insurance Experiment
- Double machine learning for static panel models with fixed effects
- Dimension Reduction Forests: Local Variable Importance Using Structured Random Forests
- Nonparametric estimation of conditional densities by generalized random forests
- To bag is to prune
- Doubly robust treatment effect estimation with missing attributes
- A Random Forest Approach for Bounded Outcome Variables
- Inference for heterogeneous treatment effects with efficient instruments and machine learning
- scientific article; zbMATH DE number 7370525 (Why is no real title available?)
- Comparing algorithms for characterizing treatment effect heterogeneity in randomized trials
- Medoid splits for efficient random forests in metric spaces
- Estimation and evaluation of individualized treatment rules following multiple imputation
- Causal mediation analysis with latent subgroups
- A tutorial on individualized treatment effect prediction from randomized trials with a binary endpoint
- Analysing opportunity cost of care work using mixed effects random forests under aggregated auxiliary data
- Comparing Covariate Prioritization via Matching to Machine Learning Methods for Causal Inference Using Five Empirical Applications
- Designing optimal, data-driven policies from multisite randomized trials
This page was built for publication: Generalized random forests
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q666599)
