Tree-structured modelling of categorical predictors in generalized additive regression
From MaRDI portal
Abstract: Generalized linear and additive models are very efficient regression tools but the selection of relevant terms becomes difficult if higher order interactions are needed. In contrast, tree-based methods also known as recursive partitioning are explicitly designed to model a specific form of interaction but with their focus on interaction tend to neglect the main effects. The method proposed here focusses on the main effects of categorical predictors by using tree type methods to obtain clusters. In particular when the predictor has many categories one wants to know which of the categories have to be distinguished with respect to their effect on the response. The tree-structured approach allows to detect clusters of categories that share the same effect while letting other variables, in particular metric variables, have a linear or additive effect on the response. An algorithm for the fitting is proposed and various stopping criteria are evaluated. The preferred stopping criterion is based on -values representing a conditional inference procedure. In addition, stability of clusters are investigated and the relevance of variables is investigated by bootstrap methods. Several applications show the usefulness of tree-structured clustering and a small simulation study demonstrates that the fitting procedure works well.
Recommendations
- scientific article; zbMATH DE number 788271
- Tree-based models for fitting stratified linear regression models
- Structured Additive Regression for Categorical Space–Time Data: A Mixed Model Approach
- scientific article; zbMATH DE number 1983958
- Generalised linear model trees with global additive effects
Cites work
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 3945130 (Why is no real title available?)
- scientific article; zbMATH DE number 47282 (Why is no real title available?)
- scientific article; zbMATH DE number 708500 (Why is no real title available?)
- scientific article; zbMATH DE number 835699 (Why is no real title available?)
- A partially linear tree-based regression model for multivariate outcomes
- A uniform framework for the combination of penalties in generalized structured models
- Additive logistic regression: a statistical view of boosting. (With discussion and a rejoinder by the authors)
- Boosting With theL2Loss
- Fast Stable Restricted Maximum Likelihood and Marginal Likelihood Estimation of Semiparametric Generalized Linear Models
- Flexible smoothing with \(B\)-splines and penalties. With comments and a rejoinder by the authors
- Generalized additive models. An introduction with R.
- Greedy function approximation: A gradient boosting machine.
- Modelling Clustered Heterogeneity: Fixed Effects, Random Effects and Mixtures
- On Grouping for Maximum Homogeneity
- Problems in the Analysis of Survey Data, and a Proposal
- RE-EM trees: a data mining approach for longitudinal and clustered data
- Random forests
- Rating scales as predictors -- the old question of scale level and some answers
- Recursive partitioning in the health sciences
- Simultaneous Factor Selection and Collapsing Levels in ANOVA
- Sparse modeling of categorial explanatory variables
- The regression trunk approach to discover treatment covariate interaction
- Tree-based varying coefficient regression for longitudinal ordinal responses
- Tree-structured model diagnostics for linear regression
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Variable importance in binary regression trees and forests
Cited in
(5)
This page was built for publication: Tree-structured modelling of categorical predictors in generalized additive regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q137407)
