One of the item types in the Listening Comprehension section of the Test of English as a Foreign Language (TOEFL) test is the dialogue. Because the dialogue item pool needs to have an appropriate balance of items at a range of difficulty levels, test developers have examined items at various difficulty levels in an attempt to identify their…

The purpose of this study was to compare the scores of students who were allowed unlimited retakes of a multiple-choice test with the scores of students who were limited to only four retakes (five trials) of the same test. The tests were each made up of 20 randomly drawn questions from a large pool of questions about research methods. Three…

CSAR (Characteristic Storage And Retrieval) is the name of an interactive item bank system for the storage, retrieval, manipulation, and summarization of information about multiple choice test items. The purpose of the system is to facilitate the test construction process. The system has two main components: one or more item banks and an…

The Test Collection, Educational Testing Service, is an extensive library of over 14,000 tests and other measurement devices. The Test Collection acquires and disseminates information on hard-to-locate research instruments as well as on commercially available standardized tests. Drawn from the Test Collection's computer-retrievable database, this…

The most appropriate statistical model for the small-scale (n<100) studies common in language testing research is the Rasch one-parameter logistic model. The Rasch model provides a wide range of options for conducting research, refining existing examinations, and developing tailored (computerized adaptive) language tests. Three investigations…

The successful Wisconsin Title 1 project item bank offers a valid, flexible, and efficient means of providing migrant student tests in reading and mathematics tailored to instructor curricula. The item bank system consists of nine PASCAL computer programs which maintain, search, and select from approximately 1,000 test items stored on floppy disks…

The development and use of item shells in the construction of a series of standardized tests of reading comprehension at the elementary school level are described. An item shell is an item that is devoid of specific content, but contains key words and a distinctive syntactic structure. The specific content of the item shell varies depending on the…

The use of item response theory (IRT) is a prerequisite to successful use of computerized test systems. In item response models, as opposed to classical test theory, the abilities of the examinees and the properties of the items are parameterized separately. Therefore, when measuring the abilities of examinees, the model implicitly corrects for…

This paper presents an explanation of the program design of the three separate Pascal-language programs which comprise UCLA's Diagnostic Testing Package "DX." The three parts of the DX test package are three closely interrelated programs--Editest, Runtest, and Summary. Editest serves the following functions: (1) the creation of a…

As one in a series of test item collections developed by the Assessment and Evaluation Unit of the Directorate of Studies, items are made available to teachers for the construction of unit tests or term examinations or as a basis for class discussion. Each collection was reviewed for content validity and reliability. The test items meet syllabus…

Item banks offer a different approach to test development than that of the more traditional item specification method. This study was designed as an initial comparative investigation in the Area. Fourth grade math and reading tests were developed using both items written from item specifications and items drawn from an existing item bank. Four…

This paper has shown the advantages of tailored testing over traditional methods, the need for latent trait theory in the application of tailored testing, and some of the results available to show the quality of estimates obtained by tailored testing procedures. Since the tailored testing procedures overcome many of the problems with traditional…

A collection of 185 objectives and related test items for students studying auto mechanics in grades 10 through 12 is provided. Auto tune-up and repair skills are emphasized. The objectives are divided into two sections: objectives calling for demonstrations of the processes, and objectives requiring written responses. Most objectives contain…

The computer can assist test construction in the following four ways: (1) storage or banking of test items; (2) banking of item attributes; (3) test construction; and (4) test printing. Automated Item Banking (AIB) is a computerized item storage and test construction system which illustrates these capabilities. It was developed, implemented, and…

By means of computer simulation of test responses, the reliability of item analysis data and the accuracy of equating were examined for hypothetical samples of 250, 500, 1000, and 2000 subjects for two tests with 20 equating items plus 60 additional items on the same scale. Birnbaum's three-parameter logistic model was used for the simulation. The…