Current methods for obtaining reliability indices for mastery tests can be laborious. This paper offers practitioners tables from which agreement and kappa coefficients can be read directly and provides criterion for acceptable values of agreement and kappa coefficients. (TJH)

In mastery testing, the raw agreement index and the kappa index may be estimated via one test administration when the test scores follow beta-binomial distributions. This paper reports formulae, tables, and a computer program which facilitate the computation of the standard errors of the estimates. (Author/CTM)

A general model along with four illustrations is presented for the consideration of budgetary constraints in the setting of passing scores in instructional programs involving remedial action for poor test performers. Budgetary constraints normally put an upper limit on any choice of passing score. Given relevant information, this limit may be…

This handbook treats a restricted set of statistical procedures for addressing some of the most prevalent technical issues that arise in domain-referenced testing. The procedures discussed here were chosen because they do not necessitate extensive computations. The five major sections of the paper cover: (1) item analysis procedures for using data…

A basic understanding of criterion-referenced test (CRT) use and development is presented with definitions and characteristics of CRTs. The steps necessary to construct and validate a CRT, the appropriate use of CRTs, the historical development of CRTs, and terms used in conjunction with CRTs are discussed. The most common definition of a CRT is a…

Procedures are described for studying the reliability of decisions based on specific passing scores with tests made up of discrete items and designed to measure continuous rather than categorical traits. These procedures are based on the estimation of the joint distribution of true scores and observed scores. (CTM)

The purpose of this book is to make it possible for measurement specialists to solve practical testing problems through the use of item response theory (IRT). The topics, organization, and presentation are those used in a 4-week seminar held each summer for the past several years. The material is organized to facilitate understanding; all related…

This document contains tier locator and mastery tests, which form part of the Comprehensive Competencies Program (CCP) for adult and high school populations. The document begins with a detailed report on the nature and purposes of the tests. The report begins by discussing the structure of the tests, which parallels the structure of the CCP, and…

The objectives of this investigation are to develop, describe, assess, and demonstrate procedures for constructing mastery tests to minimize errors of classification and to maximize decision reliability. The guidelines are based on conditions where item exchangeability is a reasonable assumption and the test constructor can control the number of…

The Social Studies assessment on the Graduation Exit Examination for the 21st Century (GEE) is designed to measure student mastery of Louisiana's social studies content standards. The GEE 21 assesses the mastery of U.S. history from the end of the reconstruction era through the 20th century. Emphasis in high school is on U.S. history from…

This user manual introduces and explains the Basic Math Mastery Tests (BMMT), a collection of 10 tests of specific mathematics skills. The tests were designed to assess mastery of specific skills required for successful performance in vocational education or in occupations requiring mathematics skills. All 10 tests are administered and scored by…

Starting with the ninth grade, Hawaiian students are given the opportunity to take the Hawaii State Test of Essential Competencies (HSTEC) to demonstrate mastery of 14 Essential Competencies. These competencies are grouped into those covering the Basic Skills area and those covering the Other Life Skills area (e.g., distinguishing fact from…

Four factors essential to determining how many items should be constructed or sampled for a set of objectives are examined: (1) importance and type of decisions to be made with the results; (2) importance and emphases assigned to the instructional and behavioral objectives; (3) number of objectives; (4) practical constraints, such as item writing…

This journal issue addresses the topic of mastery learning at both the elementary and secondary school levels. The first article, "The Theory and Practice of Mastery Learning" (Guskey), gives a definition of and information about the development, operation, and application of mastery learning, based on the theories of Benjamin Bloom. In…

This newsletter is part of an effort to improve mastery of the Texas Educational Assessment of Minimum Skills (TEAMS). Responses of teachers to a survey in the Spring of 1987 concerning their beliefs and facts about the TEAMS are reported, along with clarifying facts about this criterion referenced test. Teaching to the TEAMS is advisable because…