A conceptual analysis of gain scores and a technically sound procedure for using such scores to compare different instructional programs are presented. The procedure proposed makes use of an index called Rescaled and Adjusted Gains within Strata (RAGS), together with a flexible but explicit procedure for score analysis and reporting. (LC)

Problems which arise when criterion referenced test results are used to evaluate the effects of an elementary school reading program are discussed. Topics include: alternative methods of analyzing test results, sensitivity of the instrument to program outcomes, and comparison of criterion referenced and norm referenced achievement test data.…

The Title I Evaluation and Reporting System (TIERS) was mandated to meet the requirements of the 1974 amendments to the Elementary and Secondary Education Act. It was hoped that TIERS would lead to a clear report of the effectiveness of Title I programs, based upon a synthesis of nationwide data. It has been extremely difficult to compare…

This paper delineates several problems which arise when criterion-referenced test results are used to evaluate the effects of a specific educational treatment. Focus is on these topics: (1) the aggregation of individual students' data on objectives, (2) the sensitivity of the instrument to instruction, (3) the interpretation of…

School unit achievement gains computed by six different methods are compared. The data include total reading scores from the Metropolitan Achievement Test administered to Title I students in 32 elementary schools. The achievement gains were computed in standard scores, grade equivalents, percentile ranks, residual scores based on individual scores…

While much has been written on the topic of criterion-referenced testing and consequently its comparison with norm-referenced testing, measurement specialists have not as readily approached the subject of the implications involved in reporting such test information. The purposes of this paper are to (1) draw distinctions between criterion and…

A study evaluated the effectiveness of the Success in Beginning Reading and Writing (SBRW) program which is based on the philosophy that children should be taught to read and write using materials they will rely on later in life. Subjects, 59 students involved in the SBRW program, were given the California Achievement Tests as pre- and posttests.…

Surveys used for program and institutional evaluation, such as self-studies conducted for accreditation review, are discussed. Frequently, these evaluations take the form of faculty surveys and student surveys. This paper explores the following general considerations associated with mail surveys and other surveys: avoidance of response bias;…

Fifty-one teachers with three or more years of teaching experience participated in an inservice workshop on the development of course content, setting of student performance objectives, and selection of instructional methods. The participants completed questionnaires and check lists which were contrasted with parallel instruments completed by 75…

This report describes the evaluation of the 1973-1974 Distar I and Distar II programs, which were used as Title I programs for first and second graders. Distar I was used with two first grade classes; Distar II was used with two second grade classes. Children who had completed two years of Distar instruction received traditional instruction in…

This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministries, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with the application of outcome…

An evaluation of materials in the sequential anthropology curriculum project with regard to student learning and teacher training is presented. The project sample consisted of 2,183 students in grades 1, 2, 4, and 5. Two forms of the anthropology achievement test were administered as pretest and posttest measures to experimental and control groups…

This chapter should not only acquaint the reader with the present state of the art on Criterion-Referenced (CR) measurement but also suggest possible directions for further inquiry. The goal of the first part of this chapter is to deal with the definitional dilemma of CR measurement by proceeding from the more traditional view of CR measurement to…