Diagnostic testing confronts several challenges at once, among which are issues of test interpretation and immediate modification of the test itself in response to the interpretation. Several methods are available for administering and evaluating a test in real-time, towards optimizing the examiner's chances of isolating a persistent pattern of…

A method of estimating the operating characteristics of a new test item added to an established test without assuming a prior model has been proposed by the author. In this paper, the author extends this logic by proposing a different hypothesized distribution of the resulting estimate. The former method used a normal approximation; the present…

In an adaptive test, the test administrator chooses test items sequentially during the test, in such a way as to adapt test difficulty to examinee ability as shown during testing. An effectively designed adaptive test can resolve the dilemma inherent in conventional test design. By tailoring tests to individuals, the adaptive test can…

Implementation of an adaptive achievement test for teaching signed-numbers operations to junior high students is described. A computer program capable of finding 240 basic errors in signed-number computations was written on the PLATO system and used for analyzing a 64-item conventional test, as well as an adaptive test of addition problems. The…

This study used a series of simulations to answer questions about the efficacy of adaptive testing raised by empirical studies. The first study showed that for reasonable high entry points, parameters estimated from paper-and-pencil test protocols cross-validated remarkably well to groups actually tested at a computer terminal. This suggested that…

Measures of consistency and completeness of order relations derived from test-type data are proposed. The measures are generalized to apply to incomplete data such as tailored testing. The measures are based on consideration of the items-plus-persons by items-plus-persons matrix as an adjacency matrix in which a 1 means that the row element…

Discusses the possible limitations and the advantages of computer-assisted language testing and several test variables which are of concern in determining test validity. The concept of computer-adaptive testing and its relationship to these variables is described. (SED)

In providing an alternative view to the previous article by Ward (TM 508 880), the author notes problems associated with adaptive testing, diagnostic testing, testing embedded in instruction, and testing through simulations. (BW)

This paper considers differences in modes of test administration, addressing three questions: (1) Do examinees respond to items in the same way across administration modes and computer interface variations? (2) What are some of the factors that can contribute to modal effects? and (3) Can item parameters calibrated from paper and pencil…

This report describes the development and testing of a computerized early literacy diagnostic assessment for students in prekindergarten to grade 3 that can measure skills across a variety of preliteracy and reading domains. The STAR Early Literacy assessment was developed by a team of more than 50 people, including literacy experts,…

A model for constrained computerized adaptive testing is proposed in which the information in the test at the ability estimate is maximized subject to a large variety of possible constraints on the contents of the test. At each item-selection step, a full test is first assembled to have maximum information at the current ability estimate fixing…

A simulation study of methods of assessing differential item functioning (DIF) in computer-adaptive tests (CATs) was conducted by Zwick, Thayer, and Wingersky (in press, 1993). Results showed that modified versions of the Mantel-Haenszel and standardization methods work well with CAT data. DIF methods were also investigated for nonadaptive…

In computerized adaptive testing (CAT), new or experimental items are frequently administered alongside operational tests to gather the pretest data needed to replenish and replace item pools. The two basic strategies used to combine pretest and operational items are embedding and appending. Variable-length CATs are preferred because of the…

Discusses the future of computerized adaptive testing (CAT), i.e., experimental tests developed by the Educational Testing Service in response to criticism of the Standardized Aptitude Tests (SATs). CAT examinations are individually tailored to each test taker, and researchers believe they are more predictive than conventional SATs. (JJD)

A study involving 209 Spanish high school students compared computer-based English vocabulary tests: (1) a self-adapted test (SAT); (2) a computerized adaptive test (CAT); (3) a conventional test; and (4) a test combining SAT and CAT. No statistically significant differences were found among test types for estimated ability or posttest anxiety.…