Many mastery decisions are made based on assessment devices that are known to be less than perfectly reliable. A significant portion of examinees who have scores near the cutting score risk misclassification, even for instruments with relatively high retest reliability. Suggestions for minimizing this risk are offered. (Author/MT)

Computerized testing has created new challenges for the production and administration of test forms. This paper describes a multi-stage, testlet-based framework for test design, assembly, and administration called computer-adaptive sequential testing (CAST). CAST is a structured testing approach that is amenable to both adaptive and mastery…

Two indices for assessing the efficiency of decisions in mastery testing are proposed. The indices are generalizations of the raw agreement index and the kappa index. Empirical examples of these indices are given. (Author/JKS)

An evaluation of a test developed by Richard W. Woodcock in 1973 to measure the reading mastery of students in kindergarten through grade 12. (DD)

Simulated data based on five test score distributions indicate that a slight modification of the asymptotic normal theory for the estimation of the p and kappa indices in mastery testing will provide results which are in close agreement with those based on small samples from the beta-binomial distribution. (Author/BW)

Techniques for classifying individuals into mastery or non-mastery status based on criterion-referenced test performance are investigated. Extensions of mastery classification techniques developed by Macready and Dayton are presented. The techniques are based on latent class and quasi-independence models. (Author/JKS)

The dependence of reliability indices for mastery tests on mean and cutoff scores was examined in the case of three decision-theoretic indices. Dependence of kappa on mean and cutoff scores was opposite to that of the proportion of correct decisions, which was linearly related to average threshold loss. (Author/BW)

A simulation study of a sequential computerized mastery test is carried out with items modeled with the 3 parameter logistic item response theory model. The examinees' responses are either identically distributed, not identically distributed, or not identically distributed together with estimation errors in the item characteristics. The…

Children aged 5-8 years (N = 64) were given 3 first- and 3 second-order tasks testing their ability to represent false beliefs about physical facts, positive emotions, and negative emotions. The children were also asked to justify their responses to the test questions. Older children were more successful than younger children at both answering the…

Consider test data, a specified set of dichotomous skills measured by the test, and an IRT cognitive diagnosis model (ICDM). Statistical estimation of the data set using the ICDM can provide examinee estimates of mastery for these skills, referred to generally as attributes. With such detailed information about each examinee, future instruction…

The classical estimate of a binomial probability function is to estimate its mean in the usual manner and to substitute the results in the appropriate expression. Two alternative estimation procedures are described and examined. Emphasis is given to the single administration estimate of the mastery test reliability. (Author/CTM)

A number of different reliability coefficients have recently been proposed for tests used to differentiate between groups such as masters and nonmasters. One promising index is the proportion of students in a class that are consistently assigned to the same mastery group across two testings. The present paper proposes a single test administration…

A procedure is described for determining the minimal length of a mastery test given certain constraints. The procedure assumes that the testor is indifferent to misclassifying some testees who score within a specified range about the passing score. An example and table are provided. (JKS)

Describes the essential elements of a new generation of tests, shows how they might promote learning, and indicates what it will take to create them. Mastery systems envisioned by the Educational Testing Service will provide immediate, elaborate feedback; express learning progress via mapping; and present "real world" test questions.…

Suggests a process for setting a cutoff score on knowledge tests for promotion, certification, and licensing: a modified Angoff method, in which a competency estimate is determined by subject matter experts, is combined with analysis of potential impact on any groups protected by the Civil Rights Act. (SK)