The Anchor Test Study provides a method for translating a pupil's score on any one of eight widely used standardized reading tests for Grades 4, 5, and 6 to a corresponding score of any of the other seven tests, as well as furnishing new nationally representative norms for each of the eight tests. In addition, the Study presents new estimates of…

A cubic spline method for smoothing equipercentile equating relationships under the common item nonequivalent populations design is described. Statistical techniques based on bootstrap estimation are presented for choosing an equating method/degree of smoothing. Smoothing decreases the estimate of random error but results in an increase in…

This report presents an investigation by the American College Testing Program (ACT) of an alternative design for the National Assessment of Educational Progress (NAEP). The proposed design greatly simplifies the data collection and analysis procedures needed to produce assessment results and has the potential to produce results that are more…

The SAT® I: Reasoning Test is administered seven times a year. Primarily for security purposes, several different test forms are given at each administration. How is it possible to compare scores obtained from different test forms and from different test administrations? The purpose of this paper is to provide an overview of the statistical…

Five papers discuss Australian education research. Issues explored include: (1) public versus private education; (2) access to and participation in higher education; (3) teacher self-evaluation; (4) test equating methods; and (5) a procedure for analyzing classroom dialogue. The validity of end-of-school assessments and the nature of teaching are…

This article traces the evolution of a quest for solving the problems involved in the analysis of multilevel data and the estimation of the value added effects of schools in influencing educational outcomes. The authors report the findings of two studies that followed several cohorts of students that were tested at two grade levels (Grade 3 and…

Currently, 848 Georgia public elementary schools that house third- and fifth-grades in the same building use the Southern Association of Colleges and Schools (SACS) accreditation as a school improvement model. The purpose of this investigation was to determine whether elementary schools that are SACS accredited increased their levels of academic…

The feasibility of constructing test forms with practically equivalent cut scores using judges' estimates of item difficulty as target "statistical" specifications was investigated. Test forms with equivalent judgmental cut scores (based on judgments of item difficulty) were assembled using items from six operational forms of the…

Three methods of equating performance assessments are compared. Equipercentile equating, item response theory (IRT) partial credit model, and IRT graded response model methods were applied to the same data using an anchor test design. Comparisons are based primarily on the resulting raw score-to-raw score tables and the effects these tables have…

An approach to detecting differential item functioning using the Rasch model with equivalent-group cross-validation was investigated. College students taking the Dental Admission Test, were divided by gender (936 females and 1,537 males) into 2 different samples. Rasch analyses were performed on both samples. Data were recalibrated after…

In some testing programs an early item analysis is performed before final scoring in order to validate the intended keys. As a result, some items which are flawed and do not discriminate well may be keyed so as to give credit to examinees no matter which answer was chosen. This is referred to as allkeying. This research examined how varying the…

A previous study of pre-equating the Scholastic Aptitude Test (SAT) using item response theory provided unacceptable equating results for SAT-mathematical data. The purpose of this study was to investigate two possible explanations for these unacceptable pre-equating results. Specifically, the calibration process, which made use of the…

Student achievement test scores were compared and equated, using three different testing methods: paper-administered, computer-administered, and computerized adaptive testing. The tests were developed from third and sixth grade mathematics item banks of the California Assessment Program. The paper and the computer-administered tests were identical…

Six methods of equating Test of English as a Foreign Language (TOEFL) test scores for samples consisting of the usual groups of examinees and groups controlled for native language representation were evaluated in terms of scale stability. The equating methods included three item response theory (IRT) variants (fixed b's scaling, a one-parameter…

The Basic Occupational Literacy Test (BOLT) measures basic skills of educationally disadvantaged adults in four content areas: reading comprehension, reading vocabulary, arithmetic computation, and arithmetic reasoning. Alternate forms of each subtest are available at each of three or four levels of difficulty. The Wide Range Scale is used to…