Missing data in value-added modeling of teacher effects
From MaRDI portal
Abstract: The increasing availability of longitudinal student achievement data has heightened interest among researchers, educators and policy makers in using these data to evaluate educational inputs, as well as for school and possibly teacher accountability. Researchers have developed elaborate "value-added models" of these longitudinal data to estimate the effects of educational inputs (e.g., teachers or schools) on student achievement while using prior achievement to adjust for nonrandom assignment of students to schools and classes. A challenge to such modeling efforts is the extensive numbers of students with incomplete records and the tendency for those students to be lower achieving. These conditions create the potential for results to be sensitive to violations of the assumption that data are missing at random, which is commonly used when estimating model parameters. The current study extends recent value-added modeling approaches for longitudinal student achievement data Lockwood et al. [J. Educ. Behav. Statist. 32 (2007) 125--150] to allow data to be missing not at random via random effects selection and pattern mixture models, and applies those methods to data from a large urban school district to estimate effects of elementary school mathematics teachers. We find that allowing the data to be missing not at random has little impact on estimated teacher effects. The robustness of estimated teacher effects to the missing data assumptions appears to result from both the relatively small impact of model specification on estimated student effects compared with the large variability in teacher effects and the downweighting of scores from students with incomplete data.
Recommendations
- Assessing Rothstein's critique of teacher value-added models
- School system evaluation by value added analysis under endogeneity
- Sensitivity to missing data assumptions: theory and an evaluation of the U.S. wage structure
- A class of pattern-mixture models for normal incomplete data
- Estimation of the mean when data contain non-ignorable missing values from a random effects model
Cites work
- scientific article; zbMATH DE number 4088699 (Why is no real title available?)
- scientific article; zbMATH DE number 837912 (Why is no real title available?)
- scientific article; zbMATH DE number 3350922 (Why is no real title available?)
- An Approximate Generalized Linear Model with Random Effects for Informative Missing Data
- Bayesian Measures of Model Complexity and Fit
- Controlling for individual heterogeneity in longitudinal models, with applications to student achievement
- Estimation and Comparison of Changes in the Presence of Informative Right Censoring by Modeling the Censoring Process
- Inference from iterative simulation using multiple sequences
- Informative Drop-Out in Longitudinal Data Analysis
- Longitudinal Data Analysis
- Missing data in value-added modeling of teacher effects
- Missing responses in generalized linear mixed models when the missing data mechanism is nonintegrable
- Mixed Effects Logistic Regression Models for Multiple Longitudinal Binary Functional Limitation Responses with Informative Drop-Out and Confounding by Baseline Outcomes
- Modeling the Drop-Out Mechanism in Repeated-Measures Studies
- Pattern-Mixture Models for Multivariate Incomplete Data
Cited in
(5)- Efficient maximum likelihood estimation of multiple membership linear mixed models, with an application to educational value-added assessments
- Assessing Rothstein's critique of teacher value-added models
- Temporally dynamic, cohort-varying value-added models
- Missing data in value-added modeling of teacher effects
- School system evaluation by value added analysis under endogeneity
This page was built for publication: Missing data in value-added modeling of teacher effects
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q641131)
