Decomposition and model selection for large contingency tables
From MaRDI portal
Abstract: Large contingency tables summarizing categorical variables arise in many areas. For example in biology when a large number of biomarkers are cross-tabulated according to their discrete expression level. Interactions of the variables are generally studied with log-linear models and the structure of a log-linear model can be visually represented by a graph from which the conditional independence structure can then be read off. However, since the number of parameters in a saturated model grows exponentially in the number of variables, this generally comes with a heavy burden as far as computational power is concerned. If we restrict ourselves to models of lower order interactions or other sparse structures we face similar problems as the number of cells remains unchanged. We therefore present a divide-and-conquer approach, where we first divide the problem into several lower-dimensional problems and then combine these to form a global solution. Our methodology is computationally feasible for log-linear interaction modeling with many categorical variables each or some of them having many categories. We demonstrate the proposed method on simulated data and apply it to a bio-medical problem in cancer research.
Recommendations
- Exploring interactions in high-dimensional tables: a bootstrap alternative to log-linear models
- On maximum likelihood estimation in sparse contingency tables
- Model selection for log-linear models of contingency tables
- Sequential category aggregation and partitioning approaches for multi-way contingency tables based on survey and census data
- Alternative statistical models and representations for large sparse multi-dimensional contingency tables
Cites work
- scientific article; zbMATH DE number 48826 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Markov fields and log-linear interaction models for contingency tables
- Model Selection and Estimation in Regression with Grouped Variables
- Random forests
- Sequential category aggregation and partitioning approaches for multi-way contingency tables based on survey and census data
Cited in
(6)- Alternative statistical models and representations for large sparse multi-dimensional contingency tables
- Stable graphical model estimation with random forests for discrete, continuous, and mixed variables
- Exploring interactions in high-dimensional tables: a bootstrap alternative to log-linear models
- Mutual conditional independence and its applications to model selection in Markov networks
- A fast procedure for model search in multidimensional contingency tables
- Sequential category aggregation and partitioning approaches for multi-way contingency tables based on survey and census data
This page was built for publication: Decomposition and model selection for large contingency tables
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2786169)
