Pursuing Sources of Heterogeneity in Modeling Clustered Population
From MaRDI portal
Abstract: Researchers often have to deal with heterogeneous population with mixed regression relationships, increasingly so in the era of data explosion. In such problems, when there are many candidate predictors, it is not only of interest to identify the predictors that are associated with the outcome, but also to distinguish the true sources of heterogeneity, i.e., to identify the predictors that have different effects among the clusters and thus are the true contributors to the formation of the clusters. We clarify the concepts of the source of heterogeneity that account for potential scale differences of the clusters and propose a regularized finite mixture effects regression to achieve heterogeneity pursuit and feature selection simultaneously. As the name suggests, the problem is formulated under an effects-model parameterization, in which the cluster labels are missing and the effect of each predictor on the outcome is decomposed to a common effect term and a set of cluster-specific terms. A constrained sparse estimation of these effects leads to the identification of both the variables with common effects and those with heterogeneous effects. We propose an efficient algorithm and show that our approach can achieve both estimation and selection consistency. Simulation studies further demonstrate the effectiveness of our method under various practical scenarios. Three applications are presented, namely, an imaging genetics study for linking genetic factors and brain neuroimaging traits in Alzheimer's disease, a public health study for exploring the association between suicide risk among adolescents and their school district characteristics, and a sport analytics study for understanding how the salary levels of baseball players are associated with their performance and contractual status.
Recommendations
- scientific article; zbMATH DE number 3925960
- scientific article; zbMATH DE number 3936992
- Modeling and estimation problems for structured heterogeneous populations
- The effect of clumped population structure on the variability of spreading dynamics
- scientific article; zbMATH DE number 5245021
- Modelling Clustered Heterogeneity: Fixed Effects, Random Effects and Mixtures
- A heterogeneity measure for cluster identification with application to disease mapping
- scientific article; zbMATH DE number 701763
- Mixture models applied to heterogeneous populations
Cites work
- \(\ell_{1}\)-penalization for mixture regression models
- A Markov model for switching regressions
- A mixture likelihood approach for generalized linear models
- A New Semiparametric Approach to Finite Mixture of Regressions using Penalized Regression via Fusion
- A tailored multivariate mixture model for detecting proteins of concordant change among virulent strains of \textit{clostridium perfringens}
- Adaptive Lasso for sparse high-dimensional regression models
- An overview of the new feature selection methods in finite mixture of regression models
- Estimation of multiple networks in Gaussian mixture models
- Hierarchical mixtures-of-experts for exponential family regression models: Approximation and maximum likelihood estimation
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Individualized Multidirectional Variable Selection
- Maximum likelihood estimation via the ECM algorithm: A general framework
- Mixture of linear mixed models using multivariate t distribution
- Multi-species distribution modeling using penalized mixture of regressions
- Parameter estimation for mixtures of skew Laplace normal distributions and application in mixture regression modeling
- Regularization and Variable Selection Via the Elastic Net
- Regularization in finite mixture of regression models with diverging number of parameters
- Sparse regression with exact clustering
- The Adaptive Lasso and Its Oracle Properties
- The solution path of the generalized lasso
- The Split Bregman Method for L1-Regularized Problems
- Variable Selection in Finite Mixture of Regression Models
- Variable Selection in Penalized Model‐Based Clustering Via Regularization on Grouped Parameters
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(8)- fmerPack
- Regression in heterogeneous problems
- Integrative Analysis for High-Dimensional Stratified Models
- Integrated subgroup identification from multi-source data
- Sequential estimation for mixture of regression models for heterogeneous population
- Heterogeneity-aware integrative regression for ancestry-specific association studies
- Integrating quantile regression for multi-source subgroup identification
- Integrative subgroup analysis for high-dimensional mixed-type multi-response data
This page was built for publication: Pursuing Sources of Heterogeneity in Modeling Clustered Population
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q130716)
