Model selection in linear mixed models

DOI10.1214/12-STS410MaRDI QIDQ252741zbMATH OpenFDO

Authors Samuel Müller, J. L. Scealy, Alan H. Welsh

Publication date 4 March 2016

Published in Statistical Science (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1306.2427, https://projecteuclid.org/euclid.ss/1369147909

zbMATH Keywords

model selectionBICAICBayes factorinformation criterialinear mixed modelCholesky decompositionfenceLASSOshrinkage methods

Mathematics Subject Classification ID

Bayesian inference (62F15) Linear regression; mixed models (62J05) Estimation in multivariate analysis (62H12) Ridge regression; shrinkage estimators (Lasso) (62J07) Generalized linear models (logistic models) (62J12) Research exposition (monographs, survey articles) pertaining to statistics (62-02)

Abstract: Linear mixed effects models are highly flexible in handling a broad range of data types and are therefore widely used in applications. A key part in the analysis of data is model selection, which often aims to choose a parsimonious model with other desirable properties from a possibly very large set of candidate statistical models. Over the last 5-10 years the literature on model selection in linear mixed models has grown extremely rapidly. The problem is much more complicated than in linear regression because selection on the covariance structure is not straightforward due to computational issues and boundary problems arising from positive semidefinite constraints on covariance matrices. To obtain a better understanding of the available methods, their properties and the relationships between them, we review a large body of literature on linear mixed model selection. We arrange, implement, discuss and compare model selection methods based on four major approaches: information criteria such as AIC or BIC, shrinkage methods based on penalized loss functions such as LASSO, the Fence procedure and Bayesian techniques.

Recommendations

• Model selection in linear mixed-effect models
• Fence methods for mixed model selection
• Consistent procedures for mixed linear model selection
• Model selection in linear mixed effect models
• Variable selection in linear mixed effects models

Cites work

• scientific article; zbMATH DE number 3553528 (Why is no real title available?)
• scientific article; zbMATH DE number 3635352 (Why is no real title available?)
• scientific article; zbMATH DE number 2006097 (Why is no real title available?)
• scientific article; zbMATH DE number 1497444 (Why is no real title available?)
• scientific article; zbMATH DE number 1562975 (Why is no real title available?)
• scientific article; zbMATH DE number 3444596 (Why is no real title available?)
• scientific article; zbMATH DE number 835699 (Why is no real title available?)
• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
• A note on conditional AIC for linear mixed-effects models
• A simplified adaptive fence procedure
• Bayes Factors and Approximations for Variance Component Models
• Bayesian Measures of Model Complexity and Fit
• Bayesian model comparison and model averaging for small-area estimation
• Bootstrap variants of the Akaike information criterion for mixed model selection
• Bootstrapping robust estimates for clustered data
• Conditional Akaike information for mixed-effects models
• Conditional and unconditional methods for selecting variables in linear mixed models
• Conditional information criteria for selecting variables in linear mixed models
• Consistent procedures for mixed linear model selection
• Counting degrees of freedom in hierarchical and other richly-parameterised models
• Covariance estimation: the GLM and regularization perspectives
• Estimating the dimension of a model
• Estimation for high-dimensional linear mixed-effects models using \(\ell_1\)-penalization
• Evaluation of some random effects methodology applicable to bird ringing data
• Fence methods for mixed model selection
• Fixed and Random Effects Selection in Mixed Effects Models
• Further analysis of the data by Akaike's information criterion and the finite corrections
• Identifying QTLs and epistasis in structured plant populations using adaptive mixed LASSO
• Incorporating LASSO effects into a mixed model for quantitative trait loci detection
• Information and complexity in statistical modeling.
• Information methods for model selection in linear mixed effects models with application to HCV data
• Invisible fence methods and the identification of differentially expressed gene sets
• Iterative estimating equations: Linear convergence and asymptotic properties
• Joint variable selection for fixed and random effects in linear mixed-effects models
• Least angle regression. (With discussion)
• Linear and generalized linear mixed models and their applications.
• Local Polynomial Mixed-Effects Models for Longitudinal Data
• Marginal Likelihood from the Gibbs Output
• Mixed-Effects Models in S and S-PLUS
• Model Selection and Estimation in Regression with Grouped Variables
• Model Selection and Model Averaging
• Model Selection and Multimodel Inference
• Model selection and Akaike's information criterion (AIC): The general theory and its analytical extensions
• Model selection in linear mixed effect models
• On Measuring and Correcting the Effects of Data Mining and Model Selection
• On the behaviour of marginal and conditional AIC in linear mixed models
• One-step sparse estimates in nonconcave penalized likelihood models
• Outlier Robust Model Selection in Linear Regression
• Pathwise coordinate optimization
• Random Effects Selection in Linear Mixed Models
• Random-Effects Models for Longitudinal Data
• Recovery of inter-block information when block sizes are unequal
• Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
• Robust model selection in generalized linear models
• Selecting mixed-effects models based on a generalized information criterion
• Semiparametric Regression
• Statistics for high-dimensional data. Methods, theory and applications.
• Testing Random Effects in the Linear Mixed Model Using Approximate Bayes Factors
• The Adaptive Lasso and Its Oracle Properties
• The Group Lasso for Logistic Regression
• The Schwarz criterion and related methods for normal linear models
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Variable selection for semiparametric mixed models in longitudinal studies
• Variable selection in linear mixed effects models

Cited in

(64)

• Mixed linear model
• A Relaxation Approach to Feature Selection for Linear Mixed Effects Models
• Non-penalty shrinkage estimation of random effect models for longitudinal data with AR(1) errors
• Conditional and unconditional methods for selecting variables in linear mixed models
• Variable selection in elliptical linear mixed model
• Consistent procedures for mixed linear model selection
• Continuous-time state-space modelling of the hot hand in basketball
• Bias-reduced marginal Akaike information criteria based on a Monte Carlo method for linear mixed-effects models
• Comparing and selecting spatial predictors using local criteria
• A test of separate hypotheses for comparing linear mixed models with non nested fixed effects
• A note on model selection using information criteria for general linear models estimated using REML
• Fixed effects testing in high-dimensional linear mixed models
• Model averaging and weight choice in linear mixed-effects models
• Model selection for functional mixed model via Gaussian process regression
• Generalized degrees of freedom and adaptive model selection in linear mixed-effects models
• Selecting an augmented random effects model
• Directions Old and New: Palaeomagnetism and Fisher (1953) Meet Modern Statistics
• Marginal ridge conceptual predictive model selection criterion in linear mixed models
• Shrinkage estimation in linear mixed models for longitudinal data
• Focused model selection for linear mixed models with an application to whale ecology
• Selection strategy for covariance structure of random effects in linear mixed-effects models
• A discussion of prior-based Bayesian information criterion (PBIC)
• Inference on variance components near boundary in linear mixed effect models
• Observed best selective prediction in small area estimation
• Non-concave penalization in linear mixed-effect models and regularized selection of fixed effects
• Small area estimation of general finite-population parameters based on grouped data
• Quasi-maximum likelihood estimation and penalized estimation under non-standard conditions
• Individual frailty excess hazard models in cancer epidemiology
• Modeling intra-individual inter-trial EEG response variability in autism
• Sparse pairwise likelihood estimation for multivariate longitudinal mixed models
• A systematic study into the factors that affect the predictive accuracy of multilevel VAR(1) models
• Model Selection for Linear Mixed Models Using Predictive Criteria
• A scalable and efficient covariate selection criterion for mixed effects regression models with unknown random effects structure
• Bayesian model selection in linear mixed models for longitudinal data
• Fence methods for mixed model selection
• A simple adaptation of variable selection software for regression models to select variables in nested error regression models
• Uniformly valid inference based on the Lasso in linear mixed models
• Small area estimation with mixed models: a review
• Model-Based Clustering of High-Dimensional Longitudinal Data via Regularization
• Comparing Bayesian variable selection to Lasso approaches for applications in psychology
• Selection model for domains across time: application to labour force survey by economic activities
• Asymptotic theory of generalized information criterion for geostatistical regression model selection
• Bayesian inference of natural selection from spatiotemporal phenotypic data
• Variable selection using conditional AIC for linear mixed models with data-driven transformations
• A penalized approach to mixed model selection via cross-validation
• Linear mixed models and penalized least squares
• Selection of linear mixed‐effects models for clustered data
• A graphical model selection tool for mixed models
• Selection of terms in random coefficient regression models
• Testing random effects in linear mixed models: another look at the F-test (with discussion)
• A computationally efficient model selection in the generalized linear mixed model
• A novel method for joint modeling of survival data and count data for both simple randomized and cluster randomized data
• Fast and approximate exhaustive variable selection for generalised linear models with APES
• A Bayesian time-varying effect model for behavioral mHealth data
• Inference and Estimation for Random Effects in High-Dimensional Linear Mixed Models
• Robust subtractive stability measures for fast and exhaustive feature importance ranking and selection in generalised linear models
• Selection of fixed effects in high dimensional linear mixed models using a multicycle ECM algorithm
• Restricted fence method for covariate selection in longitudinal data analysis
• Multi-level block designs for comparative experiments
• On generalized degrees of freedom with application in linear mixed models selection
• Subset Selection for Linear Mixed Models
• Graphical Tools for Detecting Departures from Linear Mixed Model Assumptions and Some Remedial Measures
• Model selection in linear mixed-effect models
• Bayesian model selection in linear mixed effects models with autoregressive(\(p\)) errors using mixture priors

Describes a project that uses

Uses Software

• SemiPar

This page was built for publication: Model selection in linear mixed models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q252741)