Multidimensional forced-choice (MFC) items have been found to be useful to reduce response biases in personality assessments. However, conventional scoring methods for the MFC items result in ipsative data, hindering the wider applications of the MFC format. In the last decade, a number of item response theory (IRT) models have been developed,…

The current study compared student performance between paper-and-pencil testing (PPT) and computer-based testing (CBT) on a large-scale statewide end-of-course English examination. Analyses were conducted at both the item and test levels. The overall results suggest that scores obtained from PPT and CBT were comparable. However, at the content…

This paper highlights the need for a systematic, content aware, and theoretically-based approach to test design. The cognitive components approach is endorsed, and is applied to the development of a computerized perceptual speed test. Psychometric literature is reviewed and shows that: every major multi-factor theory includes a clerical/perceptual…

A method of automatically selecting items for inclusion in a test with constraints on item content and statistical properties was applied to real data. Tests constructed manually from the same data and constraints were compared to tests constructed automatically. Results show areas in which automated assembly can improve test construction. (SLD)

Twelve structural models of similarity were fitted to data from conventional and computer adaptive test (CAT) batteries measuring the same aptitude in a double cross-validation design. Three of the 12 models, including a multiplicative structure model, performed well, providing support for using CATs as replacements for conventional tests. (NSF)

A developed computer-administered form of the Hamilton Anxiety Scale and the clinician form of the instrument were administered to 214 psychiatric outpatients and 78 community adults. Results support the reliability and validity of the computer-administered version as an alternative to the clinician-administered version. (SLD)

The use of paper and pencil, videotape recordings, and microcomputers in student testing provide three very different views of student achievement. Paper and pencil tests can record how students compose tests and documents, and how they critique documents or performances. Video recordings can record how students explain ideas, answer questions,…

Computer simulations were run to measure the relationship between testlet validity and factors of item pool size and testlet length for both adaptive and linearly constructed testlets. Making a testlet adaptive yields only modest increases in aggregate validity because of the peakedness of the typical proficiency distribution. (Author/SLD)

To investigate the psychometric feasibility of replacing a paper-and-pencil licensing examination with a computer-administered test, a validity study was conducted. The computer-administered test (Cadm) was a common set of items for all test takers, distinct from computerized adaptive testing, in which test takers receive items appropriate to…

Two studies investigated the comparability of scores from paper-and-pencil and computer-administered versions of the College-Level Examination Program (CLEP) General Examinations in mathematics and English composition. The first study used a prototype computer-administered version on each examination for 94 students for mathematics and 116 for…

Developed paper-and-pencil and microcomputer versions of prototype occupational interest inventory for academically disadvantaged or functionally illiterate adults. Compared results obtained from 30 such adults on the United States Employment Service Interest Inventory and both versions of the prototype inventory. Results revealed acceptable…

A computer-administered version of the Yale-Brown Obsessive-Compulsive Scale was administered to 31 patients with obsessive-compulsive disorder, 16 with other anxiety disorders, and 23 nonpatient controls. The computer version correlated highly with the clinician-administered version and was well understood and liked by subjects. (SLD)

This report examines how selection fairness is influenced by the characteristics of a selection instrument in terms of its distribution of item difficulties, level of item discrimination, degree of item bias, and testing strategy. Computer simulation was used in the administration of either a conventional or Bayesian adaptive ability test to a…

The history of the Educational Testing Service (ETS) Factor Kits is summarized. The original ETS Factor Kit was developed in 1954 and contained 51 items, three each for each of 15 factors and six for a 16th factor. The next edition was developed in 1963 and included adaptations (clones) of the defining tests instead of the exact copies. These…

An overview of the development of a computerized version of the Differential Aptitude Tests (DAT) is presented. It describes the previously existing printed version of the DAT, design of the computerized adaptive edition, calibration of the test items for use in the computerized version, and two field studies that compared the Adaptive and…