To measure "treatment" effects, social science researchers typically rely on nonexperimental data. In education, school and teacher effects on students are often measured through value-added models (VAMs) that are not fully understood. We propose a framework that relates to the education production function in its most flexible form and…

Panel or grouped data are often used to allow for unobserved individual heterogeneity in econometric models via fixed effects. In this paper, we discuss identification of a panel data model in which the unobserved heterogeneity both enters additively and interacts with treatment variables. We present identification and estimation methods for…

Background: Educational and developmental psychologists often examine how groups change over time. Two analytic procedures -- analysis of covariance (ANCOVA) and the gain score model -- each seem well suited for the simplest situation, with just two groups and two time points. They can produce different results, what is known as Lord's paradox.…

While states are no longer required to set up teacher evaluation systems based in significant part on student test scores, quite a few continue to use value-added (VAMs) or student growth percentile (SGP) models for that purpose. In this study, we analyzed three years of teacher data to illustrate the performance of teachers' median growth…

At least sixteen US states have taken steps toward holding teacher preparation programs (TPPs) accountable for teacher value-added to student test scores. Yet it is unclear whether teacher quality differences between TPPs are large enough to make an accountability system worthwhile. Several statistical practices can make differences between TPPs…

Value-added assessment methods have been criticized by researchers and policy makers for a number of reasons. One issue includes the sensitivity of model results across different outcome measures. This study examined the utility of incorporating multivariate latent variable approaches within a traditional value-added framework. We evaluated the…

This article begins by thinking about the process of accreditation in general and examining whether it is a transactional or value-added activity. The overall systems of U.S accreditation and National Association for Developmental Education (NADE) accreditation are reviewed.

The Every Student Succeeds Act (ESSA) proposes changes in how states include the nation's growing population of English Learners (ELs) into the accountability system. The purpose of this paper is to identify key issues and questions that might be considered and explored by state decision makers in this area. Our primary audience is anyone in a…

This qualitative case study focused on 13 elementary teachers' perceptions of their evaluations. Using multiple schools (5) and teachers (13) we explored the impact of evaluations on instruction. Informed by Pekrun's control-value theory, our analysis focused on teachers' motivations and emotions. Teachers did not value or feel in control of their…

Value-added estimates of teacher or school quality are increasingly used for both high- and low-stakes accountability purposes, making understanding of their limitations critical. A review of the recent value-added literature suggests three concerns with the state of the research. First, the issues receiving the most research attention have not…

A key question facing teacher evaluation systems is how to combine multiple measures of complex constructs into composite indicators of performance. We use data from the Measures of Effective Teaching (MET) study to investigate the measurement properties of composite indicators obtained under various conjunctive, disjunctive (or complementary),…

In this article, several ways to adjust gross school effects are discussed to set the stage for estimating treatment effects in schooling. Although it is quite hazardous to hypothesize realistic benchmarks for results from meta-analyses, because of the dependency of effect sizes on subject matter area, grade level, and study characteristics, a…

Houston's experience with the Educational Value-Added Assessment System (R) (EVAAS) raises questions that other districts should consider before buying the software and using it for high-stakes decisions. Researchers found that teachers in Houston, all of whom were under the EVAAS gun, but who taught relatively more racial minority students,…

The traditional approach to estimating the consistency of school effects across subject areas and the stability of school effects across time is to fit separate value-added multilevel models to each subject or cohort and to correlate the resulting empirical Bayes predictions. We show that this gives biased correlations and these biases cannot be…

While much has been written about the effects of standardized testing on student achievement, less work has addressed how parents take up this information. Drawing on a survey of 286 parents in a diverse urban school district, this research illuminates three aspects of parental response to test score information: 1) how parents relate various…