This study focused on the robustness of unidimensional item response theory (UIRT) models in computerized classification testing against violation of the unidimensionality assumption. The study addressed whether UIRT models remain acceptable under various testing conditions and dimensionality strengths. Monte Carlo simulation techniques were used…

This research investigates whether the Computer-Based Academic Assessment System (CAAS), a battery of tests examining speed and accuracy at performing component reading skills, would be useful for identifying reading disability in college students. One important question was whether CAAS could distinguish reading disability from non-disability or…

When items are selected during a computerized adaptive test (CAT) solely with regard to their measurement properties, it is commonly found that certain items are administered to nearly every examinee, and that a small number of the available items will account for a large proportion of the item administrations. This presents a clear security risk…

In adaptive testing, item selection is sequentially optimized during the test. Since the optimization takes place over a pool of items calibrated with estimation error, capitalization on these errors is likely to occur. How serious the consequences of this phenomenon are depends not only on the distribution of the estimation errors in the pool or…

The purpose of many certification or licensure tests is to identify candidates who possess some level of minimum competence to practice their profession. In general, this type of test is referred to as classification testing. When this type of test is administered with a computer, the test is a computerized classification test (CCT). This paper…

This paper highlights the need for a systematic, content aware, and theoretically-based approach to test design. The cognitive components approach is endorsed, and is applied to the development of a computerized perceptual speed test. Psychometric literature is reviewed and shows that: every major multi-factor theory includes a clerical/perceptual…

The described program was designed to capitalize on state-of-the-art technologies in computer-aided testing to develop accurate measures of psychomotor ability (eye-hand coordination) and then to investigate different ways to use these psychomotor measures in the selection of pilot training candidates. This report documents the validation of two…

Computer-adaptive testing (CAT) allows improved security, greater scoring accuracy, shorter testing periods, quicker availability of results, and reduced guessing and other undesirable test behavior. Simple approaches can be applied by the classroom teacher, or other content specialist, who possesses simple computer equipment and elementary…

Nine methods for automated test construction are described. All are based on the concepts of information from item response theory. Two general kinds of methods for the construction of parallel tests are presented: (1) sequential test design; and (2) simultaneous test design. Sequential design implies that the tests are constructed one after the…

This procedure for testing the mastery of programming skills uses online testing and correction. The student is presented with a test problem and is asked to solve it, encode the solution, debug the code, and save it on a floppy disk. The instructor corrects the program at the appropriate points through the use of REM statements. The erroneous or…

This discussion of the use of microcomputer software in a medical school class for the purposes of emulating oral examinations begins by stating the three major goals of testing in medical school. The limitations of multiple choice tests and oral examinations are then discussed, and the use and suitability of computers to administer and to avoid…

This paper presents examples of effective uses of microcomputers to support basic statistics instruction. All programs are written in Applesoft BASIC for Apple II Plus microcomputers and compatible equipment. They have been field tested in statistics courses at the University of Maryland. Microcomputers can be used with color monitors for…

The development of a computer-based, university-wide testing system at Brigham Young University is discussed, as is its application to two large-enrollment math classes. The hardware configuration, software applications, general philosophy, budget, and personnel requirements of the system are also explained. Development of the system over time is…

Computer managed instruction (CMI) is proposed as a solution to the managerial problems created when introductory level courses with large numbers of students are taught using a self-paced, mastery-learning approach, e.g., Keller's Personalized System of Instruction (PSI). This paper discusses the educational premises of CMI, the advantages of CMI…

In an invitational address to the Victorian Institute of Educational Research, the author discussed Bayesian theory and its relationship to the design and construction of tailored or adaptive tests. Bayesian thinking involves recognizing the role of prior probabilities and using these probabilities in combination with new data to arrive at future…