Background: Large-scale randomised controlled trials are relatively rare in education. The present study approximates to, but is not exactly, a randomised controlled trial. It was an attempt to scale up previous small peer tutoring projects, while investing only modestly in continuing professional development for teachers. Purpose: A two-year…

The current study will examine possible contextual effects relative to differences in reading comprehension performance in the state of Florida. While the Reading First (RF) Impact study examined such difference using a regression discontinuity design, the authors are primarily interested in other analytic methods that might answer different…

Investigated two variance estimation procedures on a normed test treated as a criterion-referenced test. The first estimation procedure estimated the standard deviation systematically higher, whereas the second procedure's estimation was systematically lower than the actual standard deviation. (Author/RC)

The purpose of the research was to explore an alternative implementation strategy for Elementary Secondary Education Act Title I evaluation Model A; that is, the use of Rasch calibrated item banks rather than traditional norm-referenced tests. A methodology for obtaining normative information for such banks involved equating a normed test with…

The tenability of the equipercentile growth assumption was investigated. This assumption is the basis of the norm referenced evaluation model (Model A) for Title I program evaluations, and supposes that a cohort of students, given no special educational intervention, will maintain the same percentile rank over the course of a school year, as…

A review of evaluation forms designed to measure the effectiveness of teacher inservice workshops reveals the absence of a standardized, norm-referenced measurement instrument. The State of Texas Education Service Center (Region 20) has developed an instrument to meet the necessary research criteria. Applicability, ease of administration, and…

This paper focuses on certain technical aspects of reading-program evaluation, noting the differences in decision-making requirements and data-collection procedures between local administrators and State and Federal evaluators. The paper discusses the following differences in decision-making requirements: evaluating groups or individuals,…

Because of misconceptions regarding appropriate measurement strategies, it is necessary to draw distinctions between two major measurement methodologies, norm-referenced and criterion-referenced measurement, as they relate to determining basic academic capabilities. Norm-referenced measures are used to ascertain an individual's performance in…

Review the progress and refinement of educational assessment during the past 40 years. Discusses the dynamic effects of the interaction between persons in various fields of educational practice and persons specializing in educational evaluation. Mentions adoption by the U.S. Army of psychological and educational tests for purposes of selection and…

Meta-analysis of Title I program evaluations shows the norm-referenced model overestimates positive effectiveness; while the regression-discontinuity design underestimates it. Potential biases include residual regression artifacts, attrition and time-of-testing problems in the norm-referenced design, and assignment, measurement, and data…

The internal validity of the RMC models, especially Model A, is examined. Concern centers on limiting evaluation to cognitive outcomes, using constant percentile as the no-treatment expectation, and using norms for one test to establish the expected no-treatment performance level for another test. (MH)

Two ESEA Title I evaluation models developed by the Resource Management Corporation (RMC), were field tested simultaneously with 560 Title I reading students, grades 2-8. Measuring instruments for models 1 and 2 were, respectively, the California Achievement Test (reading vocabulary section), a norm-referenced test; and the Tarmac Reading…

Despite their advantages over other assessment techniques, current achievement and ability tests are not especially efficient sources of information for the range of educational decisions for which they are used and relied upon. Two major types of tests, criterion-referenced and norm-referenced, and two types of use, student evaluation and program…

In the 1992-93 school year, in response to a request from the Board of Trustees of the Austin Independent School District (Texas) (AISD), the district's Office of Research and Evaluation conducted a retrospective examination of the 1991-92 AISD programs to determine cost-effectiveness when possible. This report describes the review process.…

Those who are charged with the evaluation of an educational program or school or effects of teaching often must consider how well students do on the variety of standardized tests they take in the course of a school year. This overview describes common types of tests students take in large-scale programs. Criterion-referenced tests are tests that…