Learning certifiably optimal rule lists for categorical data
From MaRDI portal
Abstract: We present the design and implementation of a custom discrete optimization technique for building rule lists over a categorical feature space. Our algorithm produces rule lists with optimal training performance, according to the regularized empirical risk, with a certificate of optimality. By leveraging algorithmic bounds, efficient data structures, and computational reuse, we achieve several orders of magnitude speedup in time and a massive reduction of memory consumption. We demonstrate that our approach produces optimal rule lists on practical problems in seconds. Our results indicate that it is possible to construct optimal sparse rule lists that are approximately as accurate as the COMPAS proprietary risk prediction tool on data from Broward County, Florida, but that are completely interpretable. This framework is a novel alternative to CART and other decision tree methods for interpretable modeling.
Recommendations
- Leveraging integer linear programming to learn optimal fair rule lists
- Learning customized and optimized lists of rules with mathematical programming
- A Bayesian framework for learning rule sets for interpretable classification
- Optimal decision trees for categorical data via integer programming
- Learning Optimal Decision Sets and Lists with SAT
Cites work
- A Bayesian CART algorithm
- A Bayesian framework for learning rule sets for interpretable classification
- A Computational Study of Search Strategies for Mixed Integer Programming
- An experimental evaluation of simplicity in rule learning
- BART: Bayesian additive regression trees
- Bayesian treed models
- Finding a short and accurate decision rule in disjunctive normal form by exhaustive search
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 1301669 (Why is no real title available?)
- Interpretable classifiers using rules and Bayesian analysis: building a better stroke prediction model
- Learning theory analysis for association rules and sequential event prediction
- Learning with decision lists of data-dependent features
- Supersparse linear integer models for optimized medical scoring systems
- To explain or to predict?
- Using decision lists to construct interpretable and parsimonious treatment regimes
- Very simple classification rules perform well on most commonly used datasets
Cited in
(25)- corels
- Learning customized and optimized lists of rules with mathematical programming
- Interpretable machine learning: fundamental principles and 10 grand challenges
- Robust subgroup discovery. Discovering subgroup lists using MDL
- SAT-based rigorous explanations for decision lists
- Leveraging integer linear programming to learn optimal fair rule lists
- SIRUS: stable and interpretable RUle set for classification
- Logic explained networks
- A Bayesian framework for learning rule sets for interpretable classification
- Classification rules in relaxed logical form
- Learning Optimal Decision Sets and Lists with SAT
- Efficient Learning of Interpretable Classification Rules
- scientific article; zbMATH DE number 7625179 (Why is no real title available?)
- Causal Rule Sets for Identifying Subgroups with Enhanced Treatment Effects
- Hybrid predictive models: when an interpretable model collaborates with a black-box model
- Learning optimized risk scores
- AI 2005: Advances in Artificial Intelligence
- SAT-based optimal classification trees for non-binary data
- The explanation game: a formal framework for interpretable machine learning
- Improving fairness generalization through a sample-robust optimization method
- Visualizing the Implicit Model Selection Tradeoff
- Considerations when learning additive explanations for black-box models
- A confidence machine for sparse high-order interaction model
- Synergies between machine learning and reasoning -- an introduction by the Kay R. Amel group
- A general theoretical framework for learning smallest interpretable models
This page was built for publication: Learning certifiably optimal rule lists for categorical data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q115375)
