The differences in types of information-processing skills developed by different instructional backgrounds affect, negatively or positively, the learning of further advanced instructional materials. If prior and subsequent instructional methods are different, a proactive inhibition effect produces low achievement scores on a post test. This poses…

Describes design of an item bank for use with lower ability mathematics students in Scottish secondary schools. Aspects of bank usage discussed include raw score translation to measures on validated scales, test design for various purposes, and ways of recording and analyzing results. Test examples with corresponding outputs are given. (Author/MBR)

Achievement testing in the next century is going to be very different. Computer technology is going to play a major role in test construction, test administration, scoring, and score reporting. New formats will become possible that incorporate visual and audio components and that permit adaption of tests to individual ability levels. (SLD)

E-rater[R] has been used by the Educational Testing Service for automated essay scoring since 1999. This paper describes a new version of e-rater (V.2) that is different from other automated essay scoring systems in several important respects. The main innovations of e-rater V.2 are a small, intuitive, and meaningful set of features used for…

The development of innovative test item types that use multimedia technology to improve item authenticity and interaction and allow for objective scoring through partial-credit scoring methodologies was studied. Science test items were developed for community college developmental students using "Authorware 3.0," an instructional compact disc. The…

A predictive adaptive testing (PAT) strategy was developed based on statistical predictive analysis, and its feasibility was studied by comparing PAT performance to those of the Flexilevel, Bayesian modal, and expected a posteriori (EAP) strategies in a simulated environment. The proposed adaptive test is based on the idea of using item difficulty…

Dichotomous search strategies (DSSs) for computerized adaptive testing are similar to golden section search strategies (GSSSs). Each middle point of successive search regions is a testing point. After each item is administered, the subject's obtained score is compared with the expected score at successive testing points. If the subject's obtained…

The following steps have been taken to accomplish the goals of the Wisconsin Pupil Assessment Program: the development of objective-referenced tests; the administration of a standardized norm-referenced test; reporting of trends in performance on these tests; and the availability of two testing services and personnel for consultation purposes.…

This book offers specific how-to advice to college faculty on every stage of the testing process, including planning the test and classifying objectives to be measured, ensuring the validity and reliability of the test, and grading in such a way as to arrive at fair grades based on relevant data. The book examines the strengths and weaknesses of…

The level of confidence in pass/fail decisions obtained with computer adaptive tests (CATs) was compared to decisions based on paper-and-pencil tests. Subjects included 645 medical technology students from 238 educational programs across the country. The tests used in this study constituted part of the subjects' review for the certification…

Using matched pairs of geography questions, a new testing method for machine-scored fill-in-the-blank, multiple-digit testing (MDT) questions was compared to the traditional multiple-choice (MC) style. Data were from 118 matched or parallel test items for 4 tests from 764 college students of geography. The new method produced superior results when…

The development and preliminary evaluation of the Computerized Adaptive Testing System (CATSYS), a new testing package for IBM-compatible microcomputers, are described. CATSYS can be used to administer and score operational adaptive tests or to conduct on-line computer simulation studies. The package incorporates several innovative features,…

This paper reports on Educational Testing Service research studies investigating the parameters critical to reliability and validity in both the direct and indirect writing ability assessment of higher education applicants. The studies involved: (1) formulating an operational definition of writing competence; (2) designing and pretesting writing…

Computerized adaptive testing (CAT) has become increasingly common in large-scale testing programs. This paper considers relevant practical issues that are likely to be faced by the developers and managers of a CAT program. The first cluster of issues is that of item pool development and maintenance. It includes such considerations as item pool…

This edition of the "Research Bulletin" is a compilation of papers presented at the annual William F. Breivogel Conference in 1993. The conference theme was alternative and portfolio assessment. Papers were grouped into assessment in general, portfolio assessment, and alternative assessments and curriculum questions. The selected papers…