Educational item banking presents observers with a considerable paradox. The development of test items from scratch is viewed as wasteful, a luxury in times of declining resources. On the other hand, item banking has failed to become a mature technology despite large amounts of money and the efforts of talented professionals. The question of which…

Item parameter estimates vary for a variety of reasons, including estimation error, characteristics of the examinee samples, and context effects (e.g., item location effects, section location effects, etc.). Although we expect variation based on theory, there is reason to believe that observed variation in item parameter estimates exceeds what…

In recent years, educational research and development has focused increased attention on ways of enhancing the instructional value of tests. This ERIC Digest summarizes some of the recent advances in linking instruction and assessment. Studies of teacher effectiveness indicate how important systematic assessment of student progress and use of test…

Linear programming models with 0-1 variables are useful for the construction of tests from an item bank. Most solution strategies for these models start with solving the relaxed 0-1 linear programming model, allowing the 0-1 variables to take on values between 0 and 1. Then, a 0-1 solution is found by just rounding, optimal rounding, or a…

Testing 1-2-3 is a general purpose testing system developed at the Computer-Based Education Research Laboratory at the University of Illinois for use on NovaNET computer-based education systems. The testing system can be used for: short, teacher-made quizzes, individualized examinations, computer managed instruction curriculum testing,…

Test validity is a concept that has often been ignored in the context of latent trait models and in modern test theory, particularly as it relates to computerized adaptive testing. Some considerations about the validity of a test and of a single item are proposed. This paper focuses on measures that are population-free and that will provide local…

The goal of this project was to develop an inexpensive, self-contained system of hardware and software to support the development, administration, and evaluation of computerized adaptive tests. Toward that goal, commercial hardware was selected and a comprehensive software called the MicroCAT Testing System was developed. The MicroCAT system was…

This manual describes and explains the commands available in the ITEMBANK package (a comprehensive test item bank). True-false, multiple-choice, short-answer, and essay items, as well as the associated answers, can be accommodated. Content domains and behavior categories exist for item classification. Most menus have instant action. Items and…

The effects of presenting test items in random order or in a sequence parallel to the order of presentation were studied by testing 92 undergraduates in an introductory psychology course at Emporia State University (Kansas). Two test forms, sequential (S) and random (R), of multiple-choice questions were prepared for four 1-hour examinations…

This paper contains the technical specifications, schematic diagrams, and program printout for a computer software package for the development and administration of diagnostic tests. The second version of the Diagnostic Testing Package DX consists of a PASCAL-based set of modules located in two main programs: (1) EDITTEST creates, modifies, and…

In this report, selection theory is used as a theoretical framework from which mathematical algorithms for tailored testing are derived. The process of tailored, or adaptive, testing is presented as analogous to personnel selection and rejection on a series of continuous variables that are related to ability. Proceeding from a single common-factor…

Although two-stage testing is not the most efficient form of adaptive testing, it has some advantages. In this paper, linear programming models are given for the construction of two-stage tests. In these models, practical constraints with respect to, among other things, test composition, administration time, and inter-item dependencies play an…

This paper describes the implementation of a computer-based approach to scoring open-ended problem lists constructed to evaluate student and practitioner clinical judgment from real or simulated records. Based on 62 previously administered and scored problem lists, the program was written in BASIC for a Heathkit H11A computer (equivalent to DEC…

The use of computer aided testing can supply a training program with timely feedback of high-quality data that will assist instructors in keeping abreast of trouble points in instruction and supply students with rapid reinforcement. This rapid reinforcement is essential in learner oaced instruction. (DS)

The recent psycholinguistic-sociolinguistic trend in foreign language teaching indicates a shift of interest away from quantitative data towards qualitative information of different kinds. Validity and relevance are stressed and so new test formats are demanded, as well as new methods of dealing with student answers. Item analysis techniques used…