Threats to the validity of the Title I Evaluation and Reporting System are covered in two parts: an annotated bibliography of reports concerned with technical issues, and a discussion of threats to validity--from the reporting system in general and from each model in particular. Threats common to all three evaluation models are reported:…

Data from the Sustaining Effects Study were used to investigate the impact of attrition. Four types of analyses were conducted: estimation of attrition rate by project, estimation of bias by project, prediction of bias at the project level, and estimation of bias associated with alternative aggregation procedures. Effects of attrition varied with…

This paper explores problems of construct validity in the evaluation of the Follow Through Planned Variation program. Comments center around political ramifications of the program evaluation design, insufficient knowledge on the part of program planners, the diversity of the experimental options, and the instability of the sample. It is suggested…

In this discussion of the use of achievement tests in evaluating Title I programs, matching content between test and curriculum is the main theme. The point is made that unless a test measures what is taught, it cannot be sensitive to whatever gains the instruction produces. Thus, if different instructional treatments have different objectives, it…

The validity of the equipercentile hypothesis of the Title I Evaluation and Reporting System (TIERS) norm-referenced evaluation model was examined. The California Achievement Test, Reading, was administered as a pretest and posttest to 3,224 seventh and ninth grade students. The equipercentile hypothesis predicts that the posttest percentile…

The tenability of the equipercentile growth assumption was investigated. This assumption is the basis of the norm referenced evaluation model (Model A) for Title I program evaluations, and supposes that a cohort of students, given no special educational intervention, will maintain the same percentile rank over the course of a school year, as…

The internal validity of the RMC models, especially Model A, is examined. Concern centers on limiting evaluation to cognitive outcomes, using constant percentile as the no-treatment expectation, and using norms for one test to establish the expected no-treatment performance level for another test. (MH)

The Michigan Department of Education implemented a large-scale social action program through its Compensatory Education School Aid Act of SY 1971-72. Schools received $200 per pupil and were held accountable for pupil achievement. This paper describes the educational delivery systems in three urban schools, the evaluation of pupil achievement, and…

Some of the problems unique to evaluation research, in particular to the evaluation of longitudinal studies of social programs, are presented. A working model found to be useful in structuring compensatory education program evaluation activities is also offered. Since the goals of social programs such as Head Start are dynamic rather than static,…

The gap-reduction model has been identified as a potential alternative to or extension of the Title I Evaluation and Reporting System (TIERS). The gap-reduction model has been recommended for the evaluation of bilingual programs, but has only recently been given consideration for evaluating local Chapter 1 programs. This report recommends that…

The work completed to date on the development and validation of a procedure for assessing the micro-environments of preschool children is summarized. It was speculated that the lack of evidence that compensatory programs facilitate developmental changes in children might be due to actual lack of influence by the programs, to the subtlety of the…

The second volume of Innovative Education Practices presents descriptions of 84 outstanding projects funded under Title III of the Elementary and Secondary Education Act. The projects are in the areas of School Administration; Special Education; Guidance; Reading, Math, and Academics; Early Childhood Education; Teacher/Staff Development;…

The Title I Evaluation and Reporting System (TIERS) was assessed to determine the effectiveness of the TIERS in meeting its statutory objectives. A second purpose was to outline directions for the future of the system in light of enactment of the Educational Consolidation and Improvement Act of 1981. Focus was on assisting the United States…

The Follow Through experience is beginning to provide compelling evidence bearing upon important policy issues in compensatory education. This evidence, coming as it does from a naturalistic quasi-experiment, cannot draw its plausibility from the conventional statistical inference appropriate to probabilistically-constructed true experiments. The…

Technical problems with norm-referenced achievement testing that can lead to the erroneous evaluation of schools for Chapter 1 Program improvement is discussed, and an alternative testing model is presented. The history of Chapter 1 testing and evaluation policies is briefly reviewed, and problems with the norm-referenced model are explored. Data…