With the increased use of computerized adaptive testing, which allows for continuous testing, new concerns about test security have evolved, one being the assurance that items in an item pool are safeguarded from theft. In this paper, the risk of score inflation and procedures to detect test takers using item preknowledge are explored. When test…

The operating characteristics of 114 mathematics pretest items from the Praxis I: Computer Based Test were analyzed in terms of item attributes and test developers' judgments of item difficulty. Item operating characteristics were defined as the difficulty, discrimination, and asymptote parameters of a three parameter logistic item response theory…

This paper discusses the design and pedagogy underpinning the use of online quiz items in which students are presented with a range of questions designed to enhance understanding of complex linguistic constructions. It explores the design of different types of quiz questions from the perspective of pedagogy and cognitive demand. The particular…

Examines the ways in which computers can assist teachers in developing good tests. Describes the program TESTWORKS in detail and provides charts comparing this program with 11 others in the areas of price, type of questions generated, computer functions, and the usefulness of each. Discusses the use of word processors and databases. (KO)

How computers are used to analyze item data is reviewed, and the information that existing item-analysis programs provide is described. Summaries of studies comparing the performance of some of these packages reveal some of their current limitations. Emphasis is on the usefulness to educational practice of these packages. (SLD)

Maximum likelihood and Bayesian procedures are presented for item selection and scoring of multidimensional adaptive tests. A demonstration with simulated response data illustrates that multidimensional adaptive testing can provide equal or higher reliabilities with fewer items than are required in one-dimensional adaptive testing. (SLD)

Reveals how English test item analysis is carried out with the help of a computer-programmed approach, what significance this has, and how beneficial it could be to teachers of English all over the world. (Author/VWL)

This report contains results of a field test conducted to determine the relationship between a Graduate Records Examination (GRE) linear computer-based test (CBT) and a paper-and-pencil (P&P) test with the same items. Recent GRE examinees participated in the field test by taking either a CBT or the P&P test. Data from the field test…

This Monte Carlo study examined the effect of complex sampling of items on the measurement of differential item functioning (DIF) using the Mantel-Haenszel procedure. Data were generated using a three-parameter logistic item response theory model according to the balanced incomplete block (BIB) design used in the National Assessment of Educational…

Computerized adaptive (CA) testing uses an algorithm to match examinee ability to item difficulty, while self-adapted (SA) testing allows the examinee to choose the difficulty of his or her items. Research comparing SA and CA testing has shown that examinees experience lower anxiety and improved performance with SA testing. All previous research…

While computer-based tests might be as simple as computerized versions of paper-and-pencil examinations, more innovative applications also exist. Examples of innovations in computer-based assessment include the use of graphics or sound, some measure of interactivity, a change in the means in which examinees responded to items, and the application…

Providing instructors an efficient way to acquire a well-defined, tailored test for a given student, or group of students, the Item Bank deals in multiple-choice, Rasch-calibrated problems which are deposited under two subject areas: reading and mathematics. Users can obtain a test which is appropriate to what their migrant students have been…

This study investigated the transfer of solution strategies between close variants of quantitative reasoning questions. Pre- and posttests were obtained from 406 college undergraduates, all of whom took the same posttest; pretests varied such that one group of participants saw close variants of one set of posttest items while other groups saw…

Computerized adaptive testing for language teaching and learning takes advantage of two properties of the computer: its number-crunching and multiple-branching capabilities. Adaptive testing has also been called tailored testing because it aims at presenting items that suit the student's competence and that are informative, using an item bank and…

This report provides an overview of the current applications of computer technology to construct test items and/or to formulate tests according to sound measurement principles. The test items may be computer-generated from strategies programmed by test constructors, or pre-constructed by item writers and stored in computer memory. The tests…