Applications of item response theory to practical testing problems including equating, differential item functioning, and computerized adaptive testing, require that item parameter estimates be placed onto a common metric. In this study, three methods for developing a common metric under item response theory are compared: (1) linking separate…

A 1992 study by R. Gershon found discrepancies when comparing the theoretical Rasch item characteristic curve with the average empirical curve for 1,304 vocabulary items administered to 7,711 students. When person-item mismatches were deleted (for any person-item interaction where the ability of the person was much higher or much lower than the…

One of the main limitations of the current generation of computer-based tests is its dependency on the multiple-choice item. This research was aimed at extending computer-based testing by bringing limited forms of performance assessment to it in the domain of mathematics. This endeavor involves not only building task types that better reflect…

The results of a small research project that studied the effect computer administration has on student performance for writing or essay tests are presented. The introduction of computer-administered tests has raised concern about the equivalence of scores generated by computer versus paper-and-pencil test versions. For this study a sample of…

The degree to which laptop and standard-size desktop computers are likely to produce comparable test results for the Graduate Record Examination (GRE) General Test was studied. Verbal, quantitative, and writing sections of a retired version of the GRE were used, since it was expected that performance on reading passages or mathematics items might…

A previous simulation study of methods for assessing item functioning (DIF) in computer-adaptive tests (CATs) showed that modified versions of the Mantel-Haenszel and standardization methods work well with CAT data. In that study, data were generated using the three-parameter logistic (3PL) model, and this same model was assumed in obtaining item…

To function effectively as a learning environment, a simulation system must present learners with situations in which they use relevant knowledge, skills, and abilities. To function effectively as an assessment, such a system must additionally be able to evoke and interpret observable evidence about targeted knowledge in a manner that is…

Acadia University (Nova Scotia) has completed year two of the Acadia Advantage initiative, which involved 1,500 students and 170 faculty using IBM notebook computers in the curriculum. By year 2000, all 4,000 students at Acadia University will have notebook computers and will be taking part in technology-enhanced courses. To assist faculty, the…

Three descriptive statistics (difficulty, discrimination, and reliability) of multiple-choice (MC) test items were compared to those of a new (1980s) format of machine-scored questions. The new method, answer-bank multi-digit testing (MDT), uses alphabetized lists of up to 1,000 alternatives and approximates the completion style of assessment…

This paper reports the results of using a three-layer backpropagation artificial neural network to predict item difficulty in a reading comprehension test. Two network structures were developed, one with and one without a sigmoid function in the output processing unit. The data set, which consisted of a table of coded test items and corresponding…

Validity data were collected on tests from five aptitude clusters: information-processing (IP) componential skills, IP metacomponential skills, practical intellectual skills, cognitive flexibility, and cognitive speed. In addition, the IP activities underlying learning were elucidated. IP componential data were derived via two approaches. The…

The relationship between perceptual structure and individual differences in cognitive ability was studied through a computerized inductive reasoning task performed by 100 college undergraduates at Cleveland State University (Ohio). Measures included two psychometric tests and a set of four computerized cognitive tasks. Two components of perceptual…

The use of a variation of linear programing (goal programing) to develop a test blueprint with multiple specification requirements, is the topic of this paper. The computer program STORM was used to develop a table of test specifications for a test that would measure achievement in introductory statistics in the subdomains of frequency…

Intended as an action guide, this book focuses on the issues, concepts, and facts relevant to the educator who wants to consider using computers to accomplish learning objectives. A short history of computers emphasizing microcomputers and their use in education is followed by a discussion of current educational uses which includes a more detailed…

In the study of perception during reading, the use of eye movement contingent control of the stimulus display has proved to be a useful research technique. With such a system, it is possible to experimentally manipulate, in real time, the characteristics of the stimulus display that is present on selected fixations as reading is in progress and to…