Representing a set of required readings for those who would keep abreast of developments in the field of educational evaluation, this book presents nine chapters, each written by a recognized scholar on the topic being considered. Several chapters are also available as separate booklets, thereby increasing the flexibility with which the materials…

Criterion-referenced testing is defined and some of its background is discussed. A distinction is made between criterion-referenced scores, norm-referenced scores, cut-off scores, criterion scores, criterion variables, and content-standard scores. The relationship between norm-referenced information and criterion-referenced information is…

The measurement information generated by CRT's is designed for use in instructional management systems where classifications of pupils for treatment are to be decided on the basis of minimal data consistent with predetermined limits for the errors of misclassification. The measures obtained are content specific estimates of proficiency useful for…

This study attempted to determine the effectiveness of cloze procedures as norm-referenced instruments by comparing the differential responses of four groups of college students of English as a second language on two identical cloze passages. The responses were scored using both exact-answer and acceptable-word methods. The results indicate that…

The second section of a four-part technical report of Florida's statewide program for assessing reading-related skills in grades 2 and 4 provides statistical and scoring information. Item and student sampling, a test re-scoring study, reporting statewide assessment data (percentage of achievement, types of tables used), and standard error…

This paper is about the structural equation modelling of quantitative measures that are obtained from a multiple facet design. A facet is simply a set consisting of a finite number of elements. It is assumed that measures are obtained by combining each element of each facet. Methods and traits are two such facets, and a multitrait-multimethod…

This study provides preliminary evidence as to the validity of measures derived from the "Tests of Scientific Thinking" (TST). The TST and the Graduate Record Examinations (GRE) were compared with regard to their relationships to interests, self-appraisals, and accomplishments of students during their first year of graduate work in…

The concept of tailored testing for individuals is applied to the construction of tests for special groups and extended to apply to item content as well as item difficulty. It is suggested that evaluators may decide to construct tests on the basis of a unique combination of items drawn from an item bank to fit the need of a particular group. At…

In an examination designed by a medical specialty board, six tests were administered to groups of candidates for certification to investigate the feasibility of using videotapes of doctor-patient interactions to assess candidates' ability to note signs of potential physical disorders during a patient's physical examination and history taking, and…

This study tests several explanations for discrepant results in an earlier study (Cook et al., 1985) which presented a partial pre-calibration method for equating new editions of the Scholastic Aptitude Test (SAT) to the same scale as older editions. In contrast to full pre-calibration, which seeks to equate all items from two or more editions,…

To examine the validity of short forms of the Wechsler Intelligence Scale for Children-Revised (WISC-R), the WISC-R was first administered to 106 hospitalized psychiatric patients, aged 8-16. No subjects had a primary diagnosis of mental retardation or learning disability, and one-third were receiving psychotropic medication. WISC-R IQ scores…

This document contains the codebooks and data record layouts for the 1985-86 Public-Use Data Tapes, Version 1.0. The Public-Use data tapes are created by the National Assessment of Educational Progress (NAEP) to provide outside researchers access to NAEP data. This book provides coded data collected on and from third graders and 9-year-olds via…

Mastery tests are analyzed in terms of the number of skills to be mastered and the number of items per skill, in order that correct decisions of mastery or nonmastery will be made to a desired degree of probability. It is assumed that a random sample of skills will be selected for measurement, that each skill will be measured by the same number of…

It is argued in this paper that generalizability theory provides a uniquely useful framework for defining and quantifying the dependability of data for decision making. It does so by requiring careful specification of the conditions of measurement and the anticipated sources of variation in the results of the measurement procedure. A distinction…

This manual outlines the rationale for using the Criterion Referenced Test (CRT) approach and suggests specific guidelines for test developers to use in constructing test items. Methods for assessing the adequacy of a CRT are also provided. (Author/RC)