Fisher scoring for crossed factor linear mixed models
From MaRDI portal
Publication:2058792
Abstract: The analysis of longitudinal, heterogeneous or unbalanced clustered data is of primary importance to a wide range of applications. The Linear Mixed Model (LMM) is a popular and flexible extension of the linear model specifically designed for such purposes. Historically, a large proportion of material published on the LMM concerns the application of popular numerical optimization algorithms, such as Newton-Raphson, Fisher Scoring and Expectation Maximization to single-factor LMMs (i.e. LMMs that only contain one "factor" by which observations are grouped). However, in recent years, the focus of the LMM literature has moved towards the development of estimation and inference methods for more complex, multi-factored designs. In this paper, we present and derive new expressions for the extension of an algorithm classically used for single-factor LMM parameter estimation, Fisher Scoring, to multiple, crossed-factor designs. Through simulation and real data examples, we compare five variants of the Fisher Scoring algorithm with one another, as well as against a baseline established by the R package lmer, and find evidence of correctness and strong computational efficiency for four of the five proposed approaches. Additionally, we provide a new method for LMM Satterthwaite degrees of freedom estimation based on analytical results, which does not require iterative gradient estimation. Via simulation, we find that this approach produces estimates with both lower bias and lower variance than the existing methods.
Recommendations
- Fisher scoring: an interpolation family and its Monte Carlo implementations
- Estimation and inference for very large linear mixed effects models
- A fast scoring algorithm for maximum likelihood estimation in unbalanced mixed models with nested random effects
- A variational maximization-maximization algorithm for generalized linear mixed models with crossed random effects
- Computation and application of generalized linear mixed model derivatives using \textit{lme4}
Cites work
- An efficient method for finding the minimum of a function of several variables without calculating derivatives
- Computing Gaussian Likelihoods and Their Derivatives for General Linear Mixed Models
- Estimation in Covariance Components Models
- Generalized Vectorization, Cross-Products, and Matrix Calculus
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 1261669 (Why is no real title available?)
- scientific article; zbMATH DE number 1748473 (Why is no real title available?)
- scientific article; zbMATH DE number 2111713 (Why is no real title available?)
- scientific article; zbMATH DE number 3412028 (Why is no real title available?)
- scientific article; zbMATH DE number 3046453 (Why is no real title available?)
- Linear mixed models. A practical guide using statistical software. With contributions from Brenda W. Gillespie
- Maximum Likelihood Computations with Repeated Measures: Application of the EM Algorithm
- Mixed models. Theory and applications with R
- Mixed-Effects Models in S and S-PLUS
- Newton-Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data
- Random-Effects Models for Longitudinal Data
- Size and power of tests for a zero random effect variance or polynomial regression in additive and linear mixed models
- Some results on commutation matrices, with statistical applications
- The Elimination Matrix: Some Lemmas and Applications
- The Estimation of Environmental and Genetic Trends from Records Subject to Culling
- Unbalanced Repeated-Measures Models with Structured Covariance Matrices
Cited in
(3)
This page was built for publication: Fisher scoring for crossed factor linear mixed models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2058792)
