The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

Discusses the need for awareness of real and potential problems in educational evaluation approaches, kinds of problems there are with true experimental designs and with quasi-experimental designs, and the criteria applied by the Joint Dissemination Review Panel to its review of educational programs. (MF)

Seven considerations in designing the Title I Evaluation and Reporting System are reviewed: satisfying state, local, and federal needs; summative evaluation; differences in Title I subprograms; local use of different achievement tests; comparative analysis data; use of approved evaluation designs; and use of a common reporting metric. (MH)

This study explored the assumption that the percentile rank of a group of students should be expected to remain the same on a post-test as on a pretest when the treatment of the group in the intervening period was the same as the treatment of the norms population. This assumption is basic to the use of the norm-referenced model for the assessment…

The content of this book is embedded in two historical frameworks. The first is the history of American education in which the basic underlying premise is that education is a means of achieving equality in our society. The other is the development of educational research in the United States which was founded on a deep conviction that one could…

A new Joint Comprehensive Evaluation System for the assessment of 15 different federal programs has been developed by the U.S. Office of Education. In this system these diverse program services will be thought of as resources available to meet the needs of critical target groups. Using this approach, a set of nine crucial questions that need to be…

The Elementary and Secondary Education Act Title I Evaluation and Reporting System is a method for giving a federally funded project in reading or math an overall score on its cognitive effectiveness. This System introduced the Normal Curve Equivalent (NCE) as an aid in aggregating Title I program scores across states and nationwide regardless of…

The orientation of this report is that of identifying educational projects which can be considered truly exemplary. The bulk of the report consists of a 23-step procedure for validating the effectiveness of educational programs using existing evaluation data. It is not intended as a guide for conducting evaluations but rather for interpreting data…

In this discussion of the use of achievement tests in evaluating Title I programs, matching content between test and curriculum is the main theme. The point is made that unless a test measures what is taught, it cannot be sensitive to whatever gains the instruction produces. Thus, if different instructional treatments have different objectives, it…

Ninth grade Elementary Secondary Education Act (ESEA) Title I evaluation results in reading and English-writing projects were compared, using the RMC Model A with local empirical norms, Model A with national interpolated norms, and Model B. The Comprehensive Tests of Basic Skills (CTBS)--Total Reading and Total Language subtests--were administered…

The Bilingual Education Evaluation System was developed to help local bilingual education projects overcome evaluation obstacles and design sound, useful evaluations within the constraints of available funding and with responsiveness to current federal legislation and regulations. The evaluation system proposed involves a process component, an…