The field of educational measurement has evolved considerably since the first doctoral programs were established. In response, programs have typically tacked on courses that address newly developed theories, methods, tools, and techniques. As our review of current programs evidences, this approach produces artificial distinctions among topics and…

In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

The McKinney-Vento Homeless Education Assistance Improvements Act of 2001 (MCKV), which provides funds to local educational agencies (LEAs), is almost a decade old, yet no evaluations of its academic effectiveness have been reported. Using a systems theory framework, the authors answer the question of whether homeless students in grade 6 from LEAs…

The Milwaukee Parental Choice Program (MPCP) is the nation's oldest and largest urban school choice program, offering private-school scholarships to low-income students in the city of Milwaukee since 1990. In the early years of the program, voucher schools were not required to test their students, though many of them did so using nationally normed…

This paper reports on an analysis of large-scale assessments of Grades 5-8 students' writing across 10 provinces and 2 territories in Canada. Theory, classroom practice, and the contributions and constraints of large-scale writing assessment are brought together with a focus on Grades 5-8 writing in order to provide both a broad view of…

Local assessment systems are being marketed as formative, benchmark, predictive, and a host of other terms. Many so-called formative assessments are not at all similar to the types of assessments and strategies studied by Black and Wiliam (1998) but instead are interim assessments. In this article, we clarify the definition and uses of interim…

This report discusses the progress of the Milwaukee Parental Choice Program (MPCP) evaluation and presents a brief summary of the main findings of the seven distinct topical reports that have been completed for 2007-08--the second year of the evaluation. Those seven specialized reports build on the five reports that were released in 2008 and are:…

The Internal Medicine In-Training Examination (ITE) is administered during residency training in the United States as a self-assessment and program assessment tool. Performance on this exam correlates with outcome on the American Board of Internal Medicine Certifying examination. Internal Medicine Program Directors use the United States Medical…

Assessments labeled as formative have been offered as a means to improve student achievement. But labels can be a powerful way to miscommunicate. For an assessment use to be appropriately labeled "formative," both empirical evidence and reasoned arguments must be offered to support the claim that improvements in student achievement can be linked…

In the summer of 2011, the Tennessee Department of Education contracted with the National Institute for Excellence in Teaching (NIET) to provide a four-day training for all evaluators across the state. NIET trained more than 5,000 evaluators intensively in the state model (districts using alternative instruments delivered their own training).…

K12 Inc. enrolls more public school students than any other private education management organization in the U.S. Much has been written about K12 Inc. (referred to in this report simply as "K12") by financial analysts and investigative journalists because it is a large, publicly traded company and is the dominant player in the operation…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

In spring 2009, the Center on Education Policy (CEP) continued its research on the impact of test-based federal and state accountability policies by conducting case studies of six high schools in six different districts within Washington State. The purpose was to learn more about the curricular and instructional changes that administrators and…

Purpose: The purpose of this paper is to describe how and why Texas A&M University at Qatar (TAMUQ) has developed a system aiming to effectively place students in freshman and developmental English programs. The placement system includes: triangulating data from external test scores, with scores from a panel-marked hand-written essay (HWE),…

To understand the contributions of the National Assessment of Educational Progress (NAEP) toward solving the problems of literacy and equity, this report addresses two questions: (1) How can NAEP provide useful information concerning educational equity and standards of and levels of literacy, particularly with regard to linguistic and ethnic…