A computer simulation study was conducted to investigate Subkoviak's index of reliability for criterion-referenced tests, called the coefficient of agreement. Results indicate that the index can be adequately estimated. (JKS)

Four different methods for estimating the proportions of testees properly classified as having mastered or not mastered test content are examined, using data from the Scholastic Aptitude Test. All four methods prove reasonably accurate and all show some bias under certain conditions. (JKS)

Classical test construction and analysis procedures are applicable and appropriate for use with criterion referenced tests when samples of both mastery and nonmastery examinees are employed. (Author/BB)

The steps discussed are (a) stating the purpose of the battery, (b) specifying performance objectives, (c) generating an item pool, (d) item analysis, (e) item selection, (f) determining cut-off scores, and (g) validating the battery. (MP)

This study examined the test-retest reliability and criterion validity of basal mastery tests of three commercial reading series. Results indicated that reliability and validity of the test varied among and within instruments. Implications for developing and using basal mastery tests are discussed. (Author/MT)

The presently viewed role and utility of measures of instructional sensitivity are summarized. A case is made that the rationale for the assessment of instructional sensitivity can be applied to all achievement tests and should not be restricted to criterion-referenced mastery tests. (Author/BW)

The discussion on criterion-referenced (CRT) and norm-referenced achievement tests (NRT) is divided into two parts: definitions and use. The authors contrast CRTs, tests which compare an individual's performance to some specified behavioral criterion of proficiency, and NRTs, tests which compare an individual's score to scores of others. They also…

The adequacy of a test developed for statewide assessment of basic mathematics skills was investigated. The test, comprised of multiple-choice items reflecting a series of behavioral objectives, was compared with a more extensive criterion measure generated from the same objectives by the application of a strict item sampling model. In many…

This study examined the effects of certain item selection methods on the classification accuracy and classification consistency of criterion-referenced instruments. Three item response data sets, representing varying situations of instructional effectiveness, were simulated. Five methods of item selection were then applied to each data set for the…

The purposes of this study were to examine the reliability and validity of a basal reading series mastery test, and to explore the appropriateness and usefulness of two strategies for investigating the reliability and validity of criterion-referenced tests. Subjects were 47 sixth graders, who were tested on the SRA Reading Achievement Test, the…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 47 fifth graders, who were tested on the SRA Reading Achievement Test, the Ginn 720 End-of-level 11 Mastery Test (MT), and the Word Reading Test. A subgroup of 22 children was tested a second time on the MT. Traditional…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 25 fourth graders, who were tested once on the SRA Reading Achievement Test, twice on the Scott-Foresman End-of-Book 9 Criterion-referenced Test (CRT), and once on the Word Reading Test. Traditional psychometric correlational…

The purpose of this study was to examine the reliability and validity of a basal reading series mastery test. Subjects were 21 fourth graders, who were tested once on the SRA Reading Achievement Test, twice on the Holt Basic Reading Series Management Program Level 13 Test (MPLT), and once on the Word Reading Test. Traditional psychometric…

Formulas are presented for decision reliability and for classification validity for mastery/nonmastery decisions based on criterion referenced tests. Two item parameters are used: the probability of a master answering an item correctly, and the probability of a nonmaster answering an item incorrectly. The theory explores the relationships of…