Item response theory parameters have to be estimated, and because of the estimation process, they do have uncertainty in them. In most large-scale testing programs, the parameters are stored in item banks, and automated test assembly algorithms are applied to assemble operational test forms. These algorithms treat item parameters as fixed values,…

This study examined the performance of the maximum Fisher's information, the maximum posterior weighted information, and the minimum expected posterior variance methods for selecting items in a computerized adaptive testing system when the items were grouped in testlets. A simulation study compared the efficiency of ability estimation among the…

In a typical study comparing the relative efficiency of two item selection rules in computerized adaptive testing, the common result is that they simultaneously differ in accuracy and security, making it difficult to reach a conclusion on which is the more appropriate rule. This study proposes a strategy to conduct a global comparison of two or…

This article presents an application of Monte Carlo methods for developing and assembling multistage adaptive tests (MSTs). A major advantage of the Monte Carlo assembly over other approaches (e.g., integer programming or enumerative heuristics) is that it provides a uniform sampling from all MSTs (or MST paths) available from a given item pool.…

The early stage of computerized adaptive testing (CAT) refers to the phase of the trait estimation during the administration of only a few items. This phase can be characterized by bias and instability of estimation. In this study, an item selection criterion is introduced in an attempt to lessen this instability: the D-optimality criterion. A…

Discusses problems of diagnosing and repairing infeasible linear-programming models in computerized test assembly. Demonstrates that it is possible to localize the causes of infeasibility, although this is not always easy. (SLD)

Reviews optimal test-assembly literature and introduces the contributions to this special issue. Discusses four approaches to computerized test assembly: (1) heuristic-based test assembly; (2) 0-1 linear programming; (3) network-flow programming; and (4) an optimal design approach. Contains a bibliography of 90 sources on test assembly.…

Applied optimal design methods to the item-bank design of adaptive testing for continuous testing situations using a version of the weighted-deviations model (M. Stocking and L. Swanson, 1993) in a simulation. Independent and overlapping item banks used items more efficiently than did a large item bank. (SLD)

Focuses on the potential contributions of optimal test-design models to practical test-assembly issues that result from limitations in the models or the technology required for their implementation and limitations inherent in the test-assembly process. Outlines research needed to make implementation of these techniques routine in test assembly.…

Compared five item selection rules with respect to the efficiency and precision of trait (theta) estimation at the early stages of computerized adaptive testing (CAT). The Fisher interval information, Fisher information with a posterior distribution, Kullback-Leibler information, and Kullback-Leibler information with a posterior distribution…

Evaluated procedures applying person-fit indices to identify individuals who had previously memorized test items in computerized adaptive-testing situations. All of the indices studied showed little power to detect the use of memorization. Discusses possibilities for altering a test when the model becomes inappropriate for an examinee. (SLD)

Provides an overview of computerized adaptive testing (CAT) and introduces contributions to this special issue. CAT elements discussed include item selection, estimation of the latent trait, item exposure, measurement precision, and item-bank development. (SLD)

The second edition of "Computerized Adaptive Testing" contains new materials related to: (1) chapter 2, system design; (2) chapter 4, item response theory, item calibration, and proficiency estimation; and (3) chapter 10, caveats, pitfalls, and unexpected consequences. The book raises critical computerized adaptive testing research and application…

Item response theory (IRT) is having a major impact on the field of testing. This special issue presents an introduction and seven papers concerning developments in IRT applications. Some important IRT research being conducted outside the United States is highlighted. (SLD)

Computerized multistage testing (MST) designs require sets of test questions (testlets) to be assembled to meet strict, often competing criteria. Rules that govern testlet assembly may dictate the number of questions on a particular subject or may describe desirable statistical properties for the test, such as measurement precision. In an MST…