This report reviews the major international and regional large-scale educational assessments, including international surveys, school-based surveys and household-based surveys. The report compares and contrasts the cognitive and contextual data collection instruments and implementation methods used by the different assessments in order to identify…

Differential item functioning (DIF) analysis is a statistical technique used for ensuring the equity and fairness of educational assessments. This study formulates a new DIF analysis method using the information similarity index (ISI). ISI compares item information functions when data fits the Rasch model. Through simulations and an international…

This handbook describes the responsibilities of district and school assessment coordinators in the administration of the Pennsylvania System of School Assessment (PSSA). This updated guidebook contains the following sections: (1) General Assessment Guidelines for All Assessments; (2) Writing Specific Guidelines; (3) Reading and Mathematics…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

Why and under which conditions do international student assessment programmes like PISA have success? How can the results of these assessments be useful for advocates of different, even contradictory, policies? What might explain different patterns of using assessment as a tool for school governance? Drawing on historical and comparative research,…

The importance of student assessment, particularly for summative purposes, has increased greatly over the past thirty years. At the same time, emphasis on including all students in assessment programs has also increased. Assessment programs, whether they are large-scale, district-based, or teacher developed, have traditionally attempted to assess…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

Since its inception in 1969, the National Assessment of Educational Progress (NAEP) has been the nation's leading indicator of what American students know and can do. The focus of this chapter is on how NAEP, as it exists today, may be useful to educators, in particular four aspects of NAEP that may be of wide interest and use. This chapter…

When evaluating the effectiveness of an educational program, multiple matrix sampling is particularly effective and efficient when the goal of the evaluation is estimating group (as opposed to individual) performance. The technique is described in some detail, with its advantages and disadvantages, and examples of its application are given.…

Develops and evaluates the linkage of the Armed Services Vocational Aptitude Battery to the mathematics scale of the National Assessment of Educational Progress. The accuracy of the proficiency distribution estimated from the projection was close to the accuracy of the distribution estimated from the large scale assessment. (SLD)

The purpose of this handbook is to assist state, district, and school personnel in implementing the Assessment Component of the Foundation Program Assessment and Improvement System (FPAIS). The FPAIS is a comprehensive system for managing curriculum, intended to improve instruction for students. The Assessment Component includes the gathering and…

Many students who are deaf or hard-of-hearing are eligible for a signing accommodation for state and other standardized tests. The signing accommodation, however, presents several challenges for testing programs that attempt to administer tests under standardized conditions. One potential solution for many of these challenges is the use of…

Guidelines for evaluating responses to requests for proposals (RFPs) for state-level educational assessment programs are presented. The guidelines articulate key choice points, options, and considerations by state (and district) testing directors as they solicit services for large-scale assessment from commercial testing companies. Focus is on…

Through a retrospective study, the methods of investigative journalism are analyzed as they are applied to a statewide evaluation of student achievement and to a local school evaluation of new student registration procedures. The benefits and shortcomings of the journalistic approach are illustrated. (Author/AL)

Examines the purposes of large-scale assessment programs, outlines the dangers and benefits of these assessments, considers the research evidence about the consequences of assessment, discusses how to evaluate assessment quality, and presents some ideas about the variables that influence the probabilities for good and bad assessment. (SLD)