Subkoviak suggested a technique for estimating both group reliability and the reliability associated with assigning a given individual to a mastery or non-mastery category based on a single test administration. Two assumptions underlie this model. First, it is assumed that had successive test administrations occurred, scores for each individual…

The Bayesian approach to setting passing scores, as proposed by Swaminathan, Hambleton, and Algina, is compared with the empirical Bayes approach to the same problem that is derived from Huynh's decision-theoretic framework. Comparisons are based on simulated data which follow an approximate beta-binomial distribution and on real test results from…

The adequacy of a test developed for statewide assessment of basic mathematics skills was investigated. The test, comprised of multiple-choice items reflecting a series of behavioral objectives, was compared with a more extensive criterion measure generated from the same objectives by the application of a strict item sampling model. In many…

Three methods for setting performance standards for criterion referenced tests--theories, expert judgments, and practical necessity--are reviewed. The author concludes that the use of performance standards is not a promising vehicle for making societal decisions. (Author/JKS)

A set of guidelines for evaluating criterion-referenced tests is presented. Additionally, 11 sets of extant criterion-referenced tests are evaluated using these guidelines. (JKS)

This special issue covers recent technical developments in the field of criterion-referenced testing. An introduction, six papers, and two commentaries dealing with test development, test score uses, and evaluation of scores review relevant literature, offer new models and/or results, and suggest directions for additional research. (SLD)

Two approaches, the minimax approach and the Rasch procedure, are described for the simultaneous determination of passing scores for subtests when the passing score for the total test is known. (Author/LMO)

This article addresses performance testing based on criterion-referenced measurement. A brief description of performance objectives is presented, followed by a discussion of the different types of performance tests: pencil and paper, identification, simulation, and work sample. Checklists and other types of rating scales are identified. (CT)

The author states that the particular types of tests used in the classroom as well as the method of administering and evaluating the test may have a marked effect on the outcome of student measurement. The three most popular tests related to writing and transcribing shorthand--shorthand vocabulary tests, dictation tests, and transcription…

Focuses on modifying personalized systems of instruction (PSI) by using competency unit testing instead of mastery testing. The algebra service courses at the University of Arizona are described. Includes data on student achievement. (MNS)

An ignored aspect of standard setting, namely the possibility that Angoff or Nedelsky judges specify inconsistent probabilities (e.g., low probabilities for easy items but large probabilities for hard items) is explored. A latent trait method is proposed to estimate such misspecifications, and an index of consistency is defined. (Author/PN)

Macready and Dayton introduced two probabilistic models for mastery assessment based on an idealistic all-or-none conception of mastery. Alternatively, an application of latent trait theory to mastery testing is proposed (a three parameter logistic model) as a more plausible model for test theory. (Author/CTM)

Procedures based on latent trait models and the Rasch model are described for computation and asymptotic statistical inference for two decision consistency indexes often used in mastery or competence testing. Simulations were conducted for typical mastery testing situations to illustrate the procedures. (SLD)

A procedure is introduced for determining the effect of testlet nonequivalence on operating characteristics of a testlet-based computerized mastery test (CMT). The procedure, which involves estimating the CMT decision rule twice with testlet likelihoods treated as equivalent or nonequivalent, is demonstrated with testlet pools from the Architect…

A theoretical framework for mastery testing based on item response theory and Bayesian decision theory is described and illustrated. Implementation depends on the availability of (1) a computerized test delivery system; (2) a pool of pretested items; and (3) a model relating observed test performance to true mastery status. (SLD)