This report describes the development of a new tool for assessment research in graduate education. The tool, the Algebra Assessment System, is based on GIDE, a pre-existing program that diagnostically analyzes complex constructed responses to algebra word problems. The project had three goals. The first goal was to build a generically usable…

This paper documents issues in converting the Figure Classification Test to the computer. The purpose of the test, which is almost entirely visual, is to determine the subject's ability to discover rules via the visual/spatial environment. The methodology of the paper-and-pencil Figure Classification Test is as follows: the subject views a series…

This paper studies whether examinee characteristics are systematically related to mode effect across paper and computer versions of the same instrument, using data from the Graduate Record Examination (GRE) of the Educational Testing Service in its Computer-Based Testing Pilot Study of 1991. The following characteristics of 1,114 examinees were…

The partial credit model of G. N. Masters (1982), a one-parameter unidimensional polychotomous Rasch model, was used to reduce the error of measurement, particularly for students near the cut score, and to permit measurement to reflect the actual ability of a student more accurately by reducing the degree of misfit for students near the cut…

This document consists of a curriculum guide combined with separately published "simulations" and "test bank" volumes designed to support instructors using the curriculum guide. The curriculum guide was developed to provide instructional materials to teachers of microcomputer application courses in Texas. The guide contains the…

This study examined scores from 133,906 operationally scored Test of English as a Foreign Language™ (TOEFL®) essays to determine whether the choice of composition medium has any impact on score quality for subgroups of test-takers. Results of analyses demonstrate that (a) scores assigned to word-processed essays are slightly more reliable than…

As a measure of musical aptitude, a new 90-item Pitch Discrimination Test was developed, and its internal structure was examined. Each of the three sections of the test measures an individual's aptitude for pitch discrimination in a different frequency range using square-wave tones generated by a personal computer. A total of 1,303 examinees,…

Three questions concerning the Binary Search Method (BSM) of computerized adaptive testing were studied: (1) whether it provided a reliable and valid estimation of examinee ability; (2) its effect on examinee attitudes toward computerized adaptive testing and conventional paper-and-pencil testing; and (3) the relationship between item response…

This handbook is intended for persons who might develop or use an item bank to support their testing program. An item bank is defined as a "large collection of distinguishable test items," with "large" explained as meaning that the number of items available is greater than the number to be used in any one test. The first section of the handbook…

This report and compilation of papers summarizes information collected by an Assessment Development and Use Project, initiated by the Northwest Regional Educational Laboratory (NWREL) to assist test development efforts by state and local agencies. Specific item banking applications are reported in two case studies, selected because they represent…

Students' macroprocessing of instruction was studied in a learning situation which used adjunct questions. The subjects were offered various macroprocessing options while reading a passage on data processing and computer programming. Each sentence appeared on a computer CRT screen one at a time. The options included: (1) review any sentence or…

The study examines the rule space model, a probabilistic model capable of measuring cognitive skill acquisition and of diagnosing erroneous rules of operation in a procedural domain. The model involves two important components: (1) determination of a set of bug distributions (bug density functions representing clusters around the rules); and (2)…

Information provided by typical and improved conventional classroom achievement tests was compared with information provided by an adaptive test covering the same subject matter. Both tests were administered to over 700 college students in a general biology course. Using the same scoring method, adaptive testing was found to yield substantially…

To what degree testing can become adaptive is considered in three ways: from a formal methodological perspective; from a human process, stability, perspective; and from a sub-system or component view within an adaptive instructional system (AIS). With the advent of large computer-based training systems, the opportunity to broadly implement…

Describes South Carolina's Governor's Remediation Initiative (GRI), an instructional management system that links diagnostic tests and teaching modules for use by high school mathematics and reading laboratories. (TW)