In January 1985, Employment and Immigration Canada funded a pilot project in New Brunswick for the development and testing of an Interprovincial Computerized Examination Management (ICEM) System. The resulting system is comprised of a dual interprovincial and provincial item bank facility, a software component offering the option of computerized…

Test-item writing efforts typically results in item pools with an undesirable correlational structure between the content attributes of the items and their statistical information. If such pools are used in computerized adaptive testing (CAT), the algorithm may be forced to select items with less than optimal information, that violate the content…

The purpose of this paper is to identify and discuss some of the problems presented by the use of computerized adaptive testing (CAT) in an instructional programs environment versus large scale testing applications, and to describe an actual implementation of CAT in an instructional programs setting. This particular application is in the…

This report describes the sequence of activities that took place as the Examination Division of the New Jersey Department of Civil Service introduced a word processing system for a test item bank and for production of camera-ready test copy. The equipment selection, installation and orientation procedures are discussed. Keyboard and CRT terminals,…

This paper presents an explanation of the program design of the three separate Pascal-language programs which comprise UCLA's Diagnostic Testing Package "DX." The three parts of the DX test package are three closely interrelated programs--Editest, Runtest, and Summary. Editest serves the following functions: (1) the creation of a…

The Learning Outcome Testing Program of the West Virginia Department of Education is designed to provide public school teachers/administrators with test questions matching learning outcomes. The approach, software selection, results of pilot tests with teachers in 13 sites, and development of test items for item banks are described. (SLD)

The assessment framework underlying a science performance monitoring program is process-oriented and intended to appeal to generalizability theory for a suitable estimation paradigm. Preliminary applications are described. Results suggest that computerized question-banking, domain-sampling of questions, and generalizablity theory together provide…

Describes advantages and disadvantages of computer-assisted foreign language testing, including unique capabilities of the computer, types of tests possible, limitations, problems, and language skill testing. The Spanish Computer Adaptive Placement Examination, developed at Brigham Young University (Utah), is described. (CB)

A teacher's manual for operating the DX System, a software package for use in diagnostic testing programs, is presented. The DX System is constructed to present test items based on the individual student's pattern of responses. Described are: (1) system components designed to run on an Apple II computer; (2) program options allowing the user to…

Before an item bank is constructed, several curriculum and testing considerations should be addressed. Such issues include the number of students enrolled in the selected subject area; number of desired objectives and items per objective; method of storing the items; and how and when to train how many teachers in item writing. The following steps…

The following steps have been taken to accomplish the goals of the Wisconsin Pupil Assessment Program: the development of objective-referenced tests; the administration of a standardized norm-referenced test; reporting of trends in performance on these tests; and the availability of two testing services and personnel for consultation purposes.…

Criterion-referenced testing (CRT) is defined as a method of ascertaining an individual's status with respect to some performance standard. Computer-assisted testing (CAT) is a method of constructing tests using a variety of computer techniques such as a single test computer printouts, stored item banks, teacher specified criteria, machine…

TAILOR is a computer program that uses the implied orders concept as the basis for computerized adaptive testing. The basic characteristics of TAILOR, which does not involve pretesting, are reviewed here and two studies of it are reported. One is a Monte Carlo simulation based on the four-parameter Birnbaum model and the other uses a matrix of…

This handbook is intended for persons who might develop or use an item bank to support their testing program. An item bank is defined as a "large collection of distinguishable test items," with "large" explained as meaning that the number of items available is greater than the number to be used in any one test. The first section of the handbook…

This report and compilation of papers summarizes information collected by an Assessment Development and Use Project, initiated by the Northwest Regional Educational Laboratory (NWREL) to assist test development efforts by state and local agencies. Specific item banking applications are reported in two case studies, selected because they represent…