Recent experience with the Computerized Adaptive Test (CAT) has raised a number of concerns about its practical applications. The concerns are principally involved with the concept of having the computer construct the test from a precalibrated item pool, and substituting statistical characteristics for the test developer's skills. Problems with…

One question regarding the utility of adaptive testing is the effect of individualized item arrangements on examinee test scores. The purpose of this study was to analyze the item difficulty choices by examinees as a function of previous item performance. The examination was a 25-item test of basic algebra skills given to 36 students in an…

An introduction by Barbara S. Plake and Joseph C. Witt defines the task of this book as presenting nine conference papers discussing probable directions for the field of measurement and testing. In an effort to contribute to the improvement of test construction and test usage, areas of present concern and potentially important areas for the future…

This paper reports on Educational Testing Service research studies investigating the parameters critical to reliability and validity in both the direct and indirect writing ability assessment of higher education applicants. The studies involved: (1) formulating an operational definition of writing competence; (2) designing and pretesting writing…

The goal of test item writing is to create measures of the true achievement dimensions desired, not extraneous abilities or related skills. To encourage university instructors to apply newer test item writing technologies to test construction for course examinations, this paper: (1) sets forth basic principles for quality item writing; (2) reviews…

While many institutions have utilized TOEFL scores for international admissions for many years, a speaking section has never before been a required part of TOEFL until the development of the iBT/Next Generation TOEFL. So institutions will need to determine how to set standards for the speaking section of TOEFL, also known as TOEFL Academic…

Simulated tailored tests were used to investigate the relationships between characteristics of the item pool and the computer program, and the reliability and bias of the resulting ability estimates. The computer program was varied to provide for various step sizes (differences in difficulty between successive steps) and different acceptance…

Criterion-referenced testing (CRT) is defined as a method of ascertaining an individual's status with respect to some performance standard. Computer-assisted testing (CAT) is a method of constructing tests using a variety of computer techniques such as a single test computer printouts, stored item banks, teacher specified criteria, machine…

The general objective of a research program on adaptive testing was to identify several sources of potential error in test scores, and to study adaptive testing as a means for reducing these errors. Errors can result from the mismatch of item difficulty to the individual's ability; the psychological effects of testing and the test environment; the…

A computer-based questionnaire was developed to help parents who have not received specialized training to determine whether their young children need further assessment for diagnosis of developmentally at-risk status. The computer automatically determines a starting point for a series of questions according to the child's chronological age. The…

This study was conducted to gather evidence regarding effects of the mode of writing (handwritten vs. word-processed) on compositional quality in a sample of sixth grade students. Questionnaire data and essay scores were gathered to examine the effect of composition mode on essay scores of students of differing computer skill levels. The study was…

This paper introduced the development and validation of the Test of Geography-Related Attitudes (ToGRA). The ToGRA measures student attitude on four discrete measures student attitude on four discrete scales: 1) leisure interest in geography; 2) enjoyment of geographic education; 3) career interest in geography; and 4) interest in place. The ToGRA…

Lowering the dropout rate of incoming mathematics and science students, and enhancing the provision of mathematics support for freshmen are two important aims of the University of Amsterdam. The approach recently adopted to support first year students is to set up a diagnostic pretest and posttest and use these tests to identify students being at…

Computerized adaptive testing (CAT) has become increasingly common in large-scale testing programs. This paper considers relevant practical issues that are likely to be faced by the developers and managers of a CAT program. The first cluster of issues is that of item pool development and maintenance. It includes such considerations as item pool…

This report contains the Proceedings of the 1982 Item Response Theory and Computerized Adaptive Testing Conference. The papers and their discussions are organized into eight sessions: (1) "Developments in Latent Trait Theory," with papers by Fumiko Samejima and Michael V. Levine; (2) "Parameter Estimation," with papers by…