Background: Large-scale randomised controlled trials are relatively rare in education. The present study approximates to, but is not exactly, a randomised controlled trial. It was an attempt to scale up previous small peer tutoring projects, while investing only modestly in continuing professional development for teachers. Purpose: A two-year…

The preliminary draft of a formal program evaluation model for special education operations in Pennsylvania is presented. Beginning chapters provide a review of literature on norm-referenced measurement, an illustration of formal and informal program evaluation in a learning disabilities context, descriptions of general implementation strategies…

The tenability of the equipercentile growth assumption was investigated. This assumption is the basis of the norm referenced evaluation model (Model A) for Title I program evaluations, and supposes that a cohort of students, given no special educational intervention, will maintain the same percentile rank over the course of a school year, as…

The internal validity of the RMC models, especially Model A, is examined. Concern centers on limiting evaluation to cognitive outcomes, using constant percentile as the no-treatment expectation, and using norms for one test to establish the expected no-treatment performance level for another test. (MH)

Two ESEA Title I evaluation models developed by the Resource Management Corporation (RMC), were field tested simultaneously with 560 Title I reading students, grades 2-8. Measuring instruments for models 1 and 2 were, respectively, the California Achievement Test (reading vocabulary section), a norm-referenced test; and the Tarmac Reading…

Technical considerations associated with item selection and reliability assessment are considered in relation to criterion-referenced tests constructed to provide group information. The purpose is to emphasize test building and the evaluation of test scores in program evaluation studies. It is stressed that an evaluator employ a performance or…

The 1975 Community/Junior College Conference sought to define and describe evaluation, discuss measuring devices, and underscore the ethical reasons for fair evaluation. William P. Gorth began by discussing the purpose of evaluation--to provide data to a specified decision-maker for decision-making--and the implications which could be drawn from…

Normative data reported by publishers of the California Achievement Test, the Comprehensive Tests of Basic Skills, and the SRA Assessment Survey were used to illustrate a procedure for specifying goals for Title I programs in terms of normal curve equivalent (NCE) gains. The procedure was based on the amount of growth reflected in student reading…

A statistical view was compiled of the impact of Elementary and Secondary Education Act (ESEA) Title I programs on student achievement in 45 of the 55 West Virginia county school districts between 1977-78. The RMC Model A-1 design was used by each district. Nationally normed achievement tests were administered for pretesting and posttesting of the…

The validity of the Comprehensive Tests of Basic Skills (CTBS) and problems associated with inappropriate norms were investigated in eleven senior high schools in Phoenix, Arizona. CTBS validity was assessed in three ways: (1) correlation between test scores and number of courses taken in that subject; (2) correlation between CTBS scores and…

Threats to the validity of the Title I Evaluation and Reporting System are covered in two parts: an annotated bibliography of reports concerned with technical issues, and a discussion of threats to validity--from the reporting system in general and from each model in particular. Threats common to all three evaluation models are reported:…

In response to growing frustration over the lack of information about the national effectiveness of the Chapter 1 program, Congress enacted the Education Amendments of 1974. Section 151 of the Amendments directed the U.S. Office of Education to develop evaluation models that would allow school district data to be aggregated to provide national…

This study explored the assumption that the percentile rank of a group of students should be expected to remain the same on a post-test as on a pretest when the treatment of the group in the intervening period was the same as the treatment of the norms population. This assumption is basic to the use of the norm-referenced model for the assessment…

Normal curve equivalent achievement gains estimates were compared with RMC Title I evaluation Models A1 and B1. The comparison focused upon the amount of bias introduced by Model A1 when its underlying assumptions were violated. The model assumes, first, that the local school population is accurately represented by the national norm group; and…

Use of the Woodcock Reading Mastery Tests (WRMT), individually administered wide ranging reading tests, was explored, using Title I evaluation Models A1 and A2. Attention was focused on: (1) relationship of the Title I curriculum to the WRMT and the SRA Reading Test; (2) comparative reading achievement gains on both tests, using Model A1; and (3)…