Predictive learning via rule ensembles
From MaRDI portal
Abstract: General regression and classification models are constructed as linear combinations of simple rules derived from the data. Each rule consists of a conjunction of a small number of simple statements concerning the values of individual input variables. These rule ensembles are shown to produce predictive accuracy comparable to the best methods. However, their principal advantage lies in interpretation. Because of its simple form, each rule is easy to understand, as is its influence on individual predictions, selected subsets of predictions, or globally over the entire space of joint input variable values. Similarly, the degree of relevance of the respective input variables can be assessed globally, locally in different regions of the input space, or at individual prediction points. Techniques are presented for automatically identifying those variables that are involved in interactions with other variables, the strength and degree of those interactions, as well as the identities of the other variables with which they interact. Graphical representations are used to visualize both main and interaction effects.
Recommendations
Cites work
- An overtraining-resistant stochastic modeling method for pattern recognition
- Bagging predictors
- Greedy function approximation: A gradient boosting machine.
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 47282 (Why is no real title available?)
- scientific article; zbMATH DE number 708500 (Why is no real title available?)
- scientific article; zbMATH DE number 739533 (Why is no real title available?)
- scientific article; zbMATH DE number 1149421 (Why is no real title available?)
- scientific article; zbMATH DE number 1179314 (Why is no real title available?)
- scientific article; zbMATH DE number 1894664 (Why is no real title available?)
- scientific article; zbMATH DE number 784360 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 5274667 (Why is no real title available?)
- On bagging and nonlinear estimation
- Quasi-regression
- Random forests
- Robust Estimation of a Location Parameter
- The elements of statistical learning. Data mining, inference, and prediction
Cited in
(89)- A Real generalization of discrete AdaBoost
- Testing conditional independence in supervised learning algorithms
- Ensemble classification based on generalized additive models
- An ensemble approach for in silico prediction of Ames mutagenicity
- Recent advances in the theory and practice of logical analysis of data
- Tree ensembles with rule structured horseshoe regularization
- Learning customized and optimized lists of rules with mathematical programming
- Explaining anomalies in groups with characterizing subspace rules
- Forest Garrote
- Consistent regression using data-dependent coverings
- Interaction forests: identifying and exploiting interpretable quantitative and qualitative interaction effects
- FOLD-R++: a scalable toolset for automated inductive learning of default theories from mixed data
- Techniques to improve ecological interpretability of black-box machine learning models. Case study on biological health of streams in the United States with gradient boosted trees
- Interpreting deep learning models with marginal attribution by conditioning on quantiles
- Conclusive local interpretation rules for random forests
- Interpretable regularized class association rules algorithm for classification in a categorical data space
- SIRUS: stable and interpretable RUle set for classification
- Crossed-derivative based sensitivity measures for interaction screening
- Data mining in electronic commerce
- Model transparency and interpretability: survey and application to the insurance industry
- Rationalizing predictions by adversarial information calibration
- Interpretation of black-box predictive models
- An improved branch-and-bound method for maximum monomial agreement
- A pool-based pattern generation algorithm for logical analysis of data with automatic fine-tuning
- pre
- Supervised classification and mathematical optimization
- Constructing ensembles of symbolic classifiers
- iml
- scientific article; zbMATH DE number 1966523 (Why is no real title available?)
- On \(b\)-bit min-wise hashing for large-scale regression and classification with sparse data
- GARROTE TREES AS TREE STRUCTURED REGRESSION ANALYSIS
- A Bayesian framework for learning rule sets for interpretable classification
- scientific article; zbMATH DE number 1832345 (Why is no real title available?)
- scientific article; zbMATH DE number 861623 (Why is no real title available?)
- Embedding black-box regression techniques into hierarchical Bayesian models
- Exploratory model comparison. Interactive model ensemble selection and management
- Classification rules in relaxed logical form
- Inference on moderation effect with third-variable effect analysis – application to explore the trend of racial disparity in oncotype dx test for breast cancer treatment
- Visualizing Variable Importance and Variable Interaction Effects in Machine Learning Models
- Linear Aggregation in Tree-Based Estimators
- Disjunctive Rule Lists
- Interactive Slice Visualization for Exploring Machine Learning Models
- A survey on the explainability of supervised machine learning
- Boosting insights in insurance tariff plans with tree-based machine learning methods
- Making complex prediction rules applicable for readers: current practice in random forest literature and recommendations
- A Shapley-Owen index for interaction quantification
- scientific article; zbMATH DE number 6276187 (Why is no real title available?)
- Node harvest
- Additive regression trees and smoothing splines -- predictive modeling and interpretation in data mining
- Guiding Local Regression Using Visualisation
- Seeing the Forest Through the Trees
- Stochastic tree search for estimating optimal dynamic treatment regimes
- hstats
- IADT
- Supervised Machine Learning Techniques: An Overview with Applications to Banking
- scientific article; zbMATH DE number 7750672 (Why is no real title available?)
- Random Forests for Spatially Dependent Data
- Patterns of differential expression by association in omic data using a new measure based on ensemble learning
- On exact distribution for multivariate weighted distributions and classification
- Understanding the effect of contextual factors and decision making on team performance in Twenty20 cricket: an interpretable machine learning approach
- Spatial performance analysis in basketball with CART, random forest and extremely randomized trees
- Considerations when learning additive explanations for black-box models
- SOAR: simultaneous or-of-and rules for classification of positive and negative classes
- Firms' profitability and ESG score: a machine learning approach
- Detection of interacting variables for generalized linear models via neural networks
- Rule ensemble method with adaptive group Lasso for heterogeneous treatment effect estimation
- Interaction analysis under misspecification of main effects: some common mistakes and simple solutions
- Generating explainable rule sets from tree-ensemble learning methods by answer set programming
- Neural-symbolic temporal decision trees for multivariate time series classification
- On the efficient implementation of classification rule learning
- Extreme value correction: a method for correcting optimistic estimations in rule learning
- Causal rule ensemble approach for multi-arm data
- Estimation of the interpretable heterogeneous treatment effect with causal subgroup discovery in survival outcomes
- A unified approach to extract interpretable rules from tree ensembles via integer programming
- From point to probabilistic gradient boosting for claim frequency and severity prediction
- Response grid plots for model-agnostic machine learning insight
- Boosting interaction tree stumps for modeling interactions
- Interpretable machine learning for survival analysis
- S-SIRUS: an explainability algorithm for spatial regression random forest
- Meta-ANOVA: screening interactions for interpretable machine learning
- The many Shapley values for explainable artificial intelligence: a sensitivity analysis perspective
- Patient subgroup identification for clinical drug development
- Survival causal rule ensemble method considering the main effect for estimating heterogeneous treatment effects
- rules
- Simplifying Random Forests’ Probabilistic Forecasts
- Employees' well-being, work-related factors, and digitalization: a decision-tree approach for imbalanced data
- The Delaunay triangulation learner and its ensembles
- Interpretable classifiers using rules and Bayesian analysis: building a better stroke prediction model
- xrf
This page was built for publication: Predictive learning via rule ensembles
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q71543)
