Computerized testing has created new challenges for the production and administration of test forms. This paper describes a multi-stage, testlet-based framework for test design, assembly, and administration called computer-adaptive sequential testing (CAST). CAST is a structured testing approach that is amenable to both adaptive and mastery…

Two indices for assessing the efficiency of decisions in mastery testing are proposed. The indices are generalizations of the raw agreement index and the kappa index. Empirical examples of these indices are given. (Author/JKS)

An evaluation of a test developed by Richard W. Woodcock in 1973 to measure the reading mastery of students in kindergarten through grade 12. (DD)

Simulated data based on five test score distributions indicate that a slight modification of the asymptotic normal theory for the estimation of the p and kappa indices in mastery testing will provide results which are in close agreement with those based on small samples from the beta-binomial distribution. (Author/BW)

Techniques for classifying individuals into mastery or non-mastery status based on criterion-referenced test performance are investigated. Extensions of mastery classification techniques developed by Macready and Dayton are presented. The techniques are based on latent class and quasi-independence models. (Author/JKS)

The dependence of reliability indices for mastery tests on mean and cutoff scores was examined in the case of three decision-theoretic indices. Dependence of kappa on mean and cutoff scores was opposite to that of the proportion of correct decisions, which was linearly related to average threshold loss. (Author/BW)

Background: Childhood obesity is a major public health threat. Increased fitness may have a positive influence on cognitive performance in both adults and children. Purpose: To examine which aspects of children's fitness assessment are associated with their performance on four different academic areas. Methods: FITNESSGRAM measures aerobic…

This dissertation investigated three instructional strategies in developmental math classes to determine if instructional strategy had a positive effect on student achievement, attitude towards mathematics, and anxiety level towards mathematics at a college in western Pennsylvania for students majoring in applied arts. The significance of this…

The classical estimate of a binomial probability function is to estimate its mean in the usual manner and to substitute the results in the appropriate expression. Two alternative estimation procedures are described and examined. Emphasis is given to the single administration estimate of the mastery test reliability. (Author/CTM)

A number of different reliability coefficients have recently been proposed for tests used to differentiate between groups such as masters and nonmasters. One promising index is the proportion of students in a class that are consistently assigned to the same mastery group across two testings. The present paper proposes a single test administration…

A procedure is described for determining the minimal length of a mastery test given certain constraints. The procedure assumes that the testor is indifferent to misclassifying some testees who score within a specified range about the passing score. An example and table are provided. (JKS)

Describes the essential elements of a new generation of tests, shows how they might promote learning, and indicates what it will take to create them. Mastery systems envisioned by the Educational Testing Service will provide immediate, elaborate feedback; express learning progress via mapping; and present "real world" test questions.…

Suggests a process for setting a cutoff score on knowledge tests for promotion, certification, and licensing: a modified Angoff method, in which a competency estimate is determined by subject matter experts, is combined with analysis of potential impact on any groups protected by the Civil Rights Act. (SK)

During the last decade the use of Bayesian statistical method has become quite prevalent in the educational community. Yet, like most statistical techniques, little has been written concerning the application of these methods to the classroom setting. The purpose of this paper is to help correct such a deficiency in the literature by developing a…

The use of Cohen's kappa index as a measure of the reliability of multiple classifications is developed. Special cases of the index as well as the effects of test length on the index are also explored. (JKS)