The example of a medical licensure test is used to demonstrate situations in which complex, integrated content must be balanced at the total test level for validity reasons, but items assigned to reportable subscore categories may be used under a multidimensional item response theory adaptive paradigm to improve subscore reliability. (SLD)

Considers equity issues of highstakes tests conducted by computer, including whether this new form of assessment actually helps level the playing field for students or represents a new cycle of assessment inequality. Two computer tests are assessed: Praxis I: Academic Skills Assessment; and the computerized version of the Graduate Record…

A polychotomous nominal response model-based computerized adaptive test (CAT) was simulated using data from 1,093 University of Texas students. The ability estimation of this model and its overall performance were compared with those of a dichotomous three-parameter logistic model-based CAT. Advantages and drawbacks of nominal response CAT are…

Using the constant information model, constant amounts of test information, and a finite interval of ability, simulated data were produced for 8 ability levels and 20 numbers of test items. Analyses suggest that it is desirable to consider modifying test information functions when they measure accuracy in ability estimation. (SLD)

Discusses the use of computerized adaptive testing (CAT) in the classroom. Highlights include item response theory; sequential probability ratio test (SPRT); combining SPRT with expert system reasoning, resulting in EXSPRT; and a study of college students that examined the efficiency and accuracy of the various CAT methods discussed. (Contains 16…

Some cautions are sounded for converting a linearly administered test to an adaptive format. Four areas are identified in which practices broadly used in traditionally constructed tests can have adverse effects if thoughtlessly adopted when a test is administered in an adaptive mode. (SLD)

A conceptual framework and heuristic model for considering the existence, magnitude, and consequences of context effects are presented through an extension of some generalizability theory concepts. Context effects are often misunderstood, and current measurement models have serious limitations for examining them. Their importance needs to be…

The precision of a computerized adaptive test (CAT) with a limited item pool was measured using test results from 4,494 nursing students. Regardless of the item pool size, CAT provides greater precision in measurement with a smaller number of items administered even when the choice of items is limited, but CAT fails to achieve equiprecision along…

This article summarizes prior research findings on self-adapted testing (SAT) and examines the hypothesis that positive effects from SAT are the result of examinees perceiving greater control over the testing situation, which may lead to reduced test anxiety and improved performance. Prior research on perceived control is also discussed. (SLD)

Time limits on some computer-adaptive tests (CATs) are such that many examinees have difficulty finishing, and some examinees may be administered tests with more time-consuming items than others. Results from over 100,000 examinees suggested that about half of the examinees must guess on the final six questions of the analytical section of the…

The purpose of this investigation was to examine the force production patterns using perceived stimulus cues from 10% to 90% of maximal force. In Experiment 1, 54 men (age: 19-34 years) and 53 women (age: 18-37 years) performed leg extensions on a dynamometer at a speed of 60 degrees/s. Participants produced actual forces perceived to be 10-90% of…

Computerized adaptive testing (CAT) is described and compared with conventional tests, and its advantages summarized. Some item response theory concepts used in CAT are summarized and illustrated. The author describes the potential usefulness of CAT in counseling and education and reviews some current issues in the implementation of CAT.

This study applied the maximum expected information (MEI) and the maximum posterior-weighted information (MPI) approaches of computer adaptive testing item selection to the case of a test using polytomous items following the partial credit model. The MEI and MPI approaches are described. A simulation study compared the efficiency of ability…

Computerized multistage testing (MST) designs require sets of test questions (testlets) to be assembled to meet strict, often competing criteria. Rules that govern testlet assembly may dictate the number of questions on a particular subject or may describe desirable statistical properties for the test, such as measurement precision. In an MST…

This article presents a psychometric model for estimating ability and item-selection strategies in self-adapted testing. In contrast to computer adaptive testing, in self-adapted testing the examinees are allowed to select the difficulty of the items. The item-selection strategy is defined as the distribution of difficulty conditional on the…