The interest in the application of large-scale adaptive testing for secure tests has served to focus attention on issues that arise when theoretical advances are made operational. Many such issues in the application of large-scale adaptive testing for secure tests have more to do with changes in testing conditions than with testing paradigms. One…

Ensuring item and pool security in a continuous testing environment is explored through a new method of controlling exposure rate of items conditional on ability level in computerized testing. Properties of this conditional control on exposure rate, when used in conjunction with a particular adaptive testing algorithm, are explored using simulated…

Explored procedures to detect test takers using item preknowledge in computerized adaptive testing and suggested a Bayesian posterior log odds ratio index for this purpose. Simulation results support the use of the odds ratio index. (SLD)

Evaluated procedures applying person-fit indices to identify individuals who had previously memorized test items in computerized adaptive-testing situations. All of the indices studied showed little power to detect the use of memorization. Discusses possibilities for altering a test when the model becomes inappropriate for an examinee. (SLD)

It is unrealistic to suppose that standard item response theory (IRT) models will be appropriate for all the new and currently considered computer-based tests. In addition to developing new models, we also need to give attention to the possibility of constructing and analyzing new tests without the aid of strong models. Computerized adaptive…

Introduces a theoretical framework for mastery testing, using Item Response Theory and Bayesian Decision Theory. The idea of sequential testing is developed, with the goal of providing longer or shorter tests as needed, and a computerized application to a hypothetical professional knowledge examination is discussed. (Author/LRW)

In the periodic testing environment associated with conventional paper-and-pencil tests, the frequency with which items are seen by test-takers is tightly controlled in advance of testing by policies that regulate both the reuse of test forms and the frequency with which candidates may take the test. In the continuous testing environment…

It is unrealistic to suppose that standard item response theory (IRT) models will be appropriate for all new and currently considered computer-based tests. In addition to developing new models, researchers will need to give some attention to the possibility of constructing and analyzing new tests without the aid of strong models. Computerized…

Constructed a pool of items from operational tests of mathematics to investigate the feasibility of using automated-test-assembly (ATA) methods to moderate simultaneously possibly irrelevant differences between the performance of women and men and African-American and White test takers. Discusses the usefulness of ATA. (SLD)

A procedure is introduced for determining the effect of testlet nonequivalence on operating characteristics of a testlet-based computerized mastery test (CMT). The procedure, which involves estimating the CMT decision rule twice with testlet likelihoods treated as equivalent or nonequivalent, is demonstrated with testlet pools from the Architect…

A theoretical framework for mastery testing based on item response theory and Bayesian decision theory is described and illustrated. Implementation depends on the availability of (1) a computerized test delivery system; (2) a pool of pretested items; and (3) a model relating observed test performance to true mastery status. (SLD)

Three different applications of the testlet concept are presented, and the psychometric models most suitable for each application are described. Difficulties that testlets can help overcome include (1) context effects; (2) item ordering; and (3) content balancing. Implications for test construction are discussed. (SLD)

With the increased use of computerized adaptive testing, which allows for continuous testing, new concerns about test security have evolved, one being the assurance that items in an item pool are safeguarded from theft. In this paper, the risk of score inflation and procedures to detect test takers using item preknowledge are explored. When test…