Information provided by typical and improved conventional classroom achievement tests was compared with information provided by an adaptive test covering the same subject matter. Both tests were administered to over 700 college students in a general biology course. Using the same scoring method, adaptive testing was found to yield substantially…

A study investigated whether a positive correlation existed between scores obtained by incoming freshman on the recently developed Degrees of Reading Power Test (DRP) and the required Reading Comprehension subtest of the New Jersey College Basic Skills Placement Test (NJCBSPT). The subjects, 217 William Paterson College freshman enrolled in a…

A detailed description of five latent structure models of achievement measurement is presented. The first project paper, by David L. McArthur, analyzes the history of mental testing to show how conventional item analysis procedures were developed, and how dissatisfaction with them has led to fragmentation. The range of distinct conceptual and…

The purpose of the present study was to empirically investigate the stability and accuracy of one suggested method for matching test difficulty to examinee ability level. Students' answers to traditional classroom tests were rescored by computer as if the examinations had been flexilevel tests. The scores thus obtained were found to correlate…

We concern ourselves with the hypothesis that two variables have a perfect disattenuated correlation, hence measure the same trait except for errors of measurement. This hypothesis is equivalent to saying, within the adopted model, that true scores of two psychological tests satisfy a linear relation. Statistical tests of this hypothesis are…

The effects of examiner unfamiliarity on the test performance of language handicapped and nonhandicapped preschoolers and school-age children are explored. Results indicate that examiner unfamiliarity selectively depresses handicapped children's test performance, constituting a systemic source of error and threatening the validity of handicapped…

This study utilized a Latin Squares design to assess equivalence of computer and paper-and-pencil testing methods in a clinical setting with college students. No significant differences between scores on measures of anxiety, depression, and psychological reactance were found across group and administration format. Most subjects preferred…

This paper addresses problems with performance on open-ended (i.e., not multiple choice) test questions administered on paper for students accustomed to writing with computers. The first section summarizes the results of three studies that examined differences between computer and paper-and-pencil test results. The second section identifies three…

This study was conducted to determine if an operational performance evaluation was valid and feasible for an area of small engine instruction. Four classes were evaluated using both a pencil-and-paper test and an operational performance test. One of the findings was that a positive relationship exists between student scores on the two tests. (LRA)

A study involving 209 Spanish high school students compared computer-based English vocabulary tests: (1) a self-adapted test (SAT); (2) a computerized adaptive test (CAT); (3) a conventional test; and (4) a test combining SAT and CAT. No statistically significant differences were found among test types for estimated ability or posttest anxiety.…

Findings of studies examining the effects of presentation media on item characteristics are reviewed. The effect of medium of presentation independent of adaptive methodology in computer-assisted testing was studied through tests of 763 Marine trainees. Conditions necessary for score equivalence between item presentation media are described. (SLD)

F. M. Lord's flexilevel, computerized adaptive testing (CAT) procedure was compared to an item-response theory-based CAT procedure that uses Bayesian ability estimation with various standard errors of estimates used for terminating the test. Ability estimates of flexilevel CATs were as accurate as were those of Bayesian CATs. (TJH)

Argues that guidelines for evaluating computer applications within psychology are not having sufficient impact on professional practices because a gap exists between information available to users and information needed to make informed decisions. Surveys of software vendors and practicing psychologists are described to support this view and…

Discussion of expert systems and computerized adaptive tests describes two versions of EXSPRT, a new approach that combines uncertain inference in expert systems with sequential probability ratio test (SPRT) stopping rules. Results of two studies comparing EXSPRT to adaptive mastery testing based on item response theory and SPRT approaches are…

A study involving 1,000 simulated examinees compared the partial credit and graded response models in computerized adaptive testing (CAT). The graded response model fit the data well and provided slightly more accurate ability estimates than those of the partial credit model. Benefits of polytomous model-based CATs are discussed. (SLD)