We evaluate the impact of Florida's test-based promotion policy on the probability that low-performing students are retained using data on the universe of third-grade students in the state of Florida from 2001 to 2004. We also examine the effect of formal exemptions to the policy on student proficiency in reading two years later. In an evaluation…

This manual has been prepared for all New Mexico Statewide Assessment Program (NMSAP) assessment administrators, teachers, school specialists, and principals. It includes information about the following topics: PED contacts, New Mexico Standards Based Assessments (SBA), Grades 3-8 and 11; New Mexico High School Competency Examination (NMHSCE);…

The purpose of this study was to examine the effect of pretest items on response time in an operational, fixed-length, time-limited computerized adaptive test (CAT). These pretest items are embedded within the CAT, but unlike the operational items, are not tailored to the examinee's ability level. If examinees with higher ability levels need less…

When an examination consists, in whole or in part, of constructed response items, it is a common practice to allow the examinee to choose among a variety of questions. This procedure is usually adopted so that the limited number of items that can be completed in the allotted time does not unfairly affect the examinee. This results in the de facto…

This report summarizes the results from two studies. The first assessed the comparability of scores derived from linear computer-based (CBT) and computer adaptive (CAT) versions of the three Graduate Record Examinations (GRE) General Test measures. A verbal CAT was taken by 1,507, a quantitative CAT by 1,354, and an analytical CAT by 995…

One important and promising application of item response theory (IRT) is computerized adaptive testing (CAT). The implementation of a nominal response model-based CAT (NRCAT) was studied. Item pool characteristics for the NRCAT as well as the comparative performance of the NRCAT and a CAT based on the three-parameter logistic (3PL) model were…

Little research exists on the psychological impacts of computerized adaptive testing (CAT) and how it may affect test performance. Three CAT procedures were examined, in which items were selected to match students' achievement levels, from the item pool at random, or according to student choice of item difficulty levels. Twenty-four graduate…

A computerized adaptive test for placement of students in postsecondary French second language courses is evaluated for unidimensionality of its three component tests: reading comprehension of a short paragraph; selection of the appropriate statement in a given situation; and a "fill-in-the-blank" section. A variety of statistical…

The purpose of this research was to compare two different forms of a placement test in French as a second language at the post-secondary level, a conventional test and a computerized test. First, expectations regarding a placement test as a measure of general proficiency are discussed and principles of adaptive testing that have been used to…

A two-stage testing strategy is one method of adapting the difficulty of a test to an individual's ability level in an effort to achieve more precise measurement. A routing test provides an initial estimate of ability level, and a second-stage measurement test then evaluates the examinee further. The measurement accuracy and efficiency of item…

The advent of computers in educational and psychological measurement has lead to the need for algorithms for optimal assembly of tests from item banks. This paper reviews the literature on optimal test assembly and introduces the contributions to this report on the topic. Four different approaches to computerized test assembly are discussed:…

This paper explores the effect of reviewing items and altering responses on the efficiency of computer adaptive tests (CATs) and the resultant ability measures of examinees. Subjects included 712 medical students: 220 subjects were randomly assigned to the review condition; 492 were randomly assigned to a review control condition (the usual CAT…

This paper explores the comparability of item calibrations for three types of items: (1) text only; (2) text with photographs; and (3) text plus graphics when items are presented on written tests and computerized adaptive tests. Data are from five different medical technology certification examinations administered nationwide in 1993. The Rasch…

Item specifications developed by the Arkansas Department of Education as part of the Minimum Performance Testing Program (MPT) appear in this document. Specifically, the social studies materials given to sixth-grade students on the MPT are included. The purpose of an item specification is to provide an overview of the general content and format of…

A computerized testing system was implemented in conjunction with the Radar Technician Training Course at the Naval Training Center, Great Lakes, Illinois. The feasibility of the system and students' attitudes toward it were examined. The system, a multilevel, microprocessor-based computer network, administered tests in a sequential, fixed length…