In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

The McKinney-Vento Homeless Education Assistance Improvements Act of 2001 (MCKV), which provides funds to local educational agencies (LEAs), is almost a decade old, yet no evaluations of its academic effectiveness have been reported. Using a systems theory framework, the authors answer the question of whether homeless students in grade 6 from LEAs…

The Milwaukee Parental Choice Program (MPCP) is the nation's oldest and largest urban school choice program, offering private-school scholarships to low-income students in the city of Milwaukee since 1990. In the early years of the program, voucher schools were not required to test their students, though many of them did so using nationally normed…

Value-added methods refer to efforts to estimate the relative contributions of specific teachers, schools, or programs to student test performance. In recent years, these methods have attracted considerable attention because of their potential applicability for educational accountability, teacher pay-for-performance systems, school and teacher…

This study examined math achievement of elementary school students when Math Out of the Box (MTB), an inquiry-based math program, was used to supplement curriculum. The sample consisted of 767 New Jersey students in the third, fourth, and fifth grades, with approximately one third using MTB. Math achievement was measured by an assessment…

This paper reports on an analysis of large-scale assessments of Grades 5-8 students' writing across 10 provinces and 2 territories in Canada. Theory, classroom practice, and the contributions and constraints of large-scale writing assessment are brought together with a focus on Grades 5-8 writing in order to provide both a broad view of…

Local assessment systems are being marketed as formative, benchmark, predictive, and a host of other terms. Many so-called formative assessments are not at all similar to the types of assessments and strategies studied by Black and Wiliam (1998) but instead are interim assessments. In this article, we clarify the definition and uses of interim…

This report discusses the progress of the Milwaukee Parental Choice Program (MPCP) evaluation and presents a brief summary of the main findings of the seven distinct topical reports that have been completed for 2007-08--the second year of the evaluation. Those seven specialized reports build on the five reports that were released in 2008 and are:…

In the summer of 2011, the Tennessee Department of Education contracted with the National Institute for Excellence in Teaching (NIET) to provide a four-day training for all evaluators across the state. NIET trained more than 5,000 evaluators intensively in the state model (districts using alternative instruments delivered their own training).…

K12 Inc. enrolls more public school students than any other private education management organization in the U.S. Much has been written about K12 Inc. (referred to in this report simply as "K12") by financial analysts and investigative journalists because it is a large, publicly traded company and is the dominant player in the operation…

The Early Assessment Program (EAP) has emerged as a national model for states seeking to design policies that increase the number of students who leave high school ready for college and careers. In addition, the two national consortia designing new assessments aligned to the Common Core State Standards have recognized the EAP as a model for the…

Background: Validity is a central concern in any assessment, though this has often not been made explicit in the UK assessment context. This article applies current validity theorising, largely derived from American formulations, to national curriculum assessments in England. Purpose: The aim is to consider validity arguments in relation to the…

Background: National curriculum tests have been administered in England for well over a decade. Although reliability evidence has been published, critics have argued that there is not enough evidence (of the right kind) and that test results may be insufficiently reliable. Purpose: This article collates and discusses evidence on the reliability of…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

In spring 2009, the Center on Education Policy (CEP) continued its research on the impact of test-based federal and state accountability policies by conducting case studies of six high schools in six different districts within Washington State. The purpose was to learn more about the curricular and instructional changes that administrators and…