In practice, vertical scales have been continually used to measure students' achievement progress across several grade levels and have been considered very challenging psychometric procedures. Recently, such practices have been drawing many criticisms. The major criticisms focus on dimensionality and construct equivalence of the latent trait or…

This document describes the breadth of the research that the ETS (Educational Testing Service) Research & Development division is conducting in 2010. This portfolio will be updated in early 2011 to reflect changes to existing projects and new projects that were added after this document was completed. The research described in this portfolio falls…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

This brief makes the case for thoughtful district- or school-driven assessment systems that complement and go beyond what statewide testing systems are able to accomplish. It describes important attributes of model local assessment programs and presents the necessary steps for building a local assessment program that will elicit information that…

This article presents the viewpoint that care must be taken to fit the specifics of a testing program to its intended purpose. Testing for diagnosing individual student learning and for school evaluation should not be confused. Statewide testing programs may provide evaluative information, but are inadequate sources of diagnostic information. (LMO)

When the drive to develop and administer tests comes from a public call for accountability in a profession, from the government's response to this call, or from politicians attempting to identify a hot issue, it may be said that the test must first have political validity in order to be implemented. Only after this political validity has been…

Two approaches, the minimax approach and the Rasch procedure, are described for the simultaneous determination of passing scores for subtests when the passing score for the total test is known. (Author/LMO)

This procedures manual for the North Carolina Test Development Program details the tasks involved in test development. The basic steps are described in an introductory section; they are (1) to specify the institutional objectives of the curriculum and ensure their instructional validity; and (2) to specify the characteristics, such as the purpose…

The use of performance assessments in accountability programs is discussed. Performance assessments have the potential to measure important objectives not easily measured by multiple-choice tests. Nevertheless, they are not suitable for every purpose, and their use should not be oversold. Many psychometric issues remain to be resolved. (SLD)

This paper presents an explanation of the program design of the three separate Pascal-language programs which comprise UCLA's Diagnostic Testing Package "DX." The three parts of the DX test package are three closely interrelated programs--Editest, Runtest, and Summary. Editest serves the following functions: (1) the creation of a…

The Delaware Student Testing Program (DSTP) is a mandated statewide assessment program that targets four core content areas. English language arts, including reading and writing, and mathematics are given to students in grades 3, 5, 8, and 10; science and social studies are given to students in grades 4, 6, 8, and 11. The DSTP reading and…

Tests in social studies and integrated science given in Saint Vincent, Saint Lucia, Grenada, and Dominica were analyzed by the Organization for Co-operation in Overseas Development (OCOD) Comprehensive Teacher Training Program (CTTP) for discrimination, difficulty, and reliability, as well as other characteristics. There were 767 examinees for the…

This study examined the curricular validity of the New Jersey Basic Skills test, a minimum competency test administered to all public school students in grades 3, 6, 9, and 11 to measure basic skills in reading and mathematics. Based on examinations of a Modified Caution Index, there were differences in the usual response patterns for both reading…

The psychometric properties of the testing tools of the Michigan Educational Assessment Program (MEAP), the state standardized testing program, are examined. Reliability studies have indicated that the scores from the MEAP, ranging from 0.654 to 0.949, are generally acceptable. The State Department of Education offered supporting evidence for the…

This technical manual provides all major existing information about the technical characteristics of the Kentucky Instructional Results Information System (KIRIS). The assessment component of the Kentucky Education Reform Act Accountability System was in use between 1991-92 and 1993-94 and was referred to as Cycle One. Two sets of test…