Predictive learning via rule ensembles
From MaRDI portal
Abstract: General regression and classification models are constructed as linear combinations of simple rules derived from the data. Each rule consists of a conjunction of a small number of simple statements concerning the values of individual input variables. These rule ensembles are shown to produce predictive accuracy comparable to the best methods. However, their principal advantage lies in interpretation. Because of its simple form, each rule is easy to understand, as is its influence on individual predictions, selected subsets of predictions, or globally over the entire space of joint input variable values. Similarly, the degree of relevance of the respective input variables can be assessed globally, locally in different regions of the input space, or at individual prediction points. Techniques are presented for automatically identifying those variables that are involved in interactions with other variables, the strength and degree of those interactions, as well as the identities of the other variables with which they interact. Graphical representations are used to visualize both main and interaction effects.
Recommendations
Cites work
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 47282 (Why is no real title available?)
- scientific article; zbMATH DE number 708500 (Why is no real title available?)
- scientific article; zbMATH DE number 739533 (Why is no real title available?)
- scientific article; zbMATH DE number 1149421 (Why is no real title available?)
- scientific article; zbMATH DE number 1179314 (Why is no real title available?)
- scientific article; zbMATH DE number 1894664 (Why is no real title available?)
- scientific article; zbMATH DE number 784360 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 5274667 (Why is no real title available?)
- An overtraining-resistant stochastic modeling method for pattern recognition
- Bagging predictors
- Greedy function approximation: A gradient boosting machine.
- On bagging and nonlinear estimation
- Quasi-regression
- Random forests
- Robust Estimation of a Location Parameter
- The elements of statistical learning. Data mining, inference, and prediction
Cited in
(83)- S-SIRUS: an explainability algorithm for spatial regression random forest
- Meta-ANOVA: screening interactions for interpretable machine learning
- The Delaunay triangulation learner and its ensembles
- Supervised classification and mathematical optimization
- SIRUS: stable and interpretable RUle set for classification
- Random Forests for Spatially Dependent Data
- scientific article; zbMATH DE number 1832345 (Why is no real title available?)
- Patterns of differential expression by association in omic data using a new measure based on ensemble learning
- On exact distribution for multivariate weighted distributions and classification
- The many Shapley values for explainable artificial intelligence: a sensitivity analysis perspective
- A Bayesian framework for learning rule sets for interpretable classification
- scientific article; zbMATH DE number 1966523 (Why is no real title available?)
- Crossed-derivative based sensitivity measures for interaction screening
- An ensemble approach for in silico prediction of Ames mutagenicity
- Firms' profitability and ESG score: a machine learning approach
- On \(b\)-bit min-wise hashing for large-scale regression and classification with sparse data
- An improved branch-and-bound method for maximum monomial agreement
- Making complex prediction rules applicable for readers: current practice in random forest literature and recommendations
- Detection of interacting variables for generalized linear models via neural networks
- Spatial performance analysis in basketball with CART, random forest and extremely randomized trees
- Understanding the effect of contextual factors and decision making on team performance in Twenty20 cricket: an interpretable machine learning approach
- scientific article; zbMATH DE number 7750672 (Why is no real title available?)
- scientific article; zbMATH DE number 6276187 (Why is no real title available?)
- Stochastic tree search for estimating optimal dynamic treatment regimes
- Guiding Local Regression Using Visualisation
- Survival causal rule ensemble method considering the main effect for estimating heterogeneous treatment effects
- Seeing the Forest Through the Trees
- Interpretation of black-box predictive models
- Supervised Machine Learning Techniques: An Overview with Applications to Banking
- pre
- iml
- rules
- Interaction analysis under misspecification of main effects: some common mistakes and simple solutions
- xrf
- A pool-based pattern generation algorithm for logical analysis of data with automatic fine-tuning
- Visualizing Variable Importance and Variable Interaction Effects in Machine Learning Models
- Consistent regression using data-dependent coverings
- Interactive Slice Visualization for Exploring Machine Learning Models
- Rule ensemble method with adaptive group Lasso for heterogeneous treatment effect estimation
- A Real generalization of discrete AdaBoost
- Data mining in electronic commerce
- Techniques to improve ecological interpretability of black-box machine learning models. Case study on biological health of streams in the United States with gradient boosted trees
- Ensemble classification based on generalized additive models
- A survey on the explainability of supervised machine learning
- Exploratory model comparison. Interactive model ensemble selection and management
- hstats
- IADT
- Conclusive local interpretation rules for random forests
- Interpreting deep learning models with marginal attribution by conditioning on quantiles
- Interpretable regularized class association rules algorithm for classification in a categorical data space
- Inference on moderation effect with third-variable effect analysis – application to explore the trend of racial disparity in oncotype dx test for breast cancer treatment
- Model transparency and interpretability: survey and application to the insurance industry
- Additive regression trees and smoothing splines -- predictive modeling and interpretation in data mining
- Generating explainable rule sets from tree-ensemble learning methods by answer set programming
- Neural-symbolic temporal decision trees for multivariate time series classification
- Boosting insights in insurance tariff plans with tree-based machine learning methods
- Rationalizing predictions by adversarial information calibration
- GARROTE TREES AS TREE STRUCTURED REGRESSION ANALYSIS
- Response grid plots for model-agnostic machine learning insight
- A Shapley-Owen index for interaction quantification
- Classification rules in relaxed logical form
- Testing conditional independence in supervised learning algorithms
- Forest Garrote
- Boosting interaction tree stumps for modeling interactions
- Linear Aggregation in Tree-Based Estimators
- Disjunctive Rule Lists
- Interpretable machine learning for survival analysis
- scientific article; zbMATH DE number 861623 (Why is no real title available?)
- On the efficient implementation of classification rule learning
- Node harvest
- Embedding black-box regression techniques into hierarchical Bayesian models
- Extreme value correction: a method for correcting optimistic estimations in rule learning
- Tree ensembles with rule structured horseshoe regularization
- Learning customized and optimized lists of rules with mathematical programming
- Interaction forests: identifying and exploiting interpretable quantitative and qualitative interaction effects
- FOLD-R++: a scalable toolset for automated inductive learning of default theories from mixed data
- Considerations when learning additive explanations for black-box models
- Interpretable classifiers using rules and Bayesian analysis: building a better stroke prediction model
- Recent advances in the theory and practice of logical analysis of data
- SOAR: simultaneous or-of-and rules for classification of positive and negative classes
- Explaining anomalies in groups with characterizing subspace rules
- Patient subgroup identification for clinical drug development
- Constructing ensembles of symbolic classifiers
This page was built for publication: Predictive learning via rule ensembles
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q71543)
