Threats to the validity of the Title I Evaluation and Reporting System are covered in two parts: an annotated bibliography of reports concerned with technical issues, and a discussion of threats to validity--from the reporting system in general and from each model in particular. Threats common to all three evaluation models are reported:…

In this discussion of the use of achievement tests in evaluating Title I programs, matching content between test and curriculum is the main theme. The point is made that unless a test measures what is taught, it cannot be sensitive to whatever gains the instruction produces. Thus, if different instructional treatments have different objectives, it…

This report examines the cost effectiveness of reading programs, as part of a large-scale evaluation of compensatory reading programs. Results from a cost analysis of these programs and from an examination of the cost-assessment model used are presented in two other reports. No conclusive relationship was found between the cost of a program and…

The tenability of the equipercentile growth assumption was investigated. This assumption is the basis of the norm referenced evaluation model (Model A) for Title I program evaluations, and supposes that a cohort of students, given no special educational intervention, will maintain the same percentile rank over the course of a school year, as…

To examine the influence of test wiseness and motivation on Title I students' performance in group standardized tests, the effects of training students and teachers in testing skills and reinforcing student testing behavior were investigated during the administration of the Stanford Achievement Test, Level II, to 597 students. Students were…

The internal validity of the RMC models, especially Model A, is examined. Concern centers on limiting evaluation to cognitive outcomes, using constant percentile as the no-treatment expectation, and using norms for one test to establish the expected no-treatment performance level for another test. (MH)

Two ESEA Title I evaluation models developed by the Resource Management Corporation (RMC), were field tested simultaneously with 560 Title I reading students, grades 2-8. Measuring instruments for models 1 and 2 were, respectively, the California Achievement Test (reading vocabulary section), a norm-referenced test; and the Tarmac Reading…

Later scholastic success is most highly related to early measures of achievement, affective status, and underperformance; affective status significantly predicts later social adjustment. Thus, neither poverty nor low achievement, both currently favored as Title I allocation criteria, should be used as sole indicators of need. (CP)

As part of the development of a functional literacy test for fourth through eigth grade children in Title I compensatory education programs, this report defines functional literacy for children and enumerates criteria for evaluating existing tests. Criteria for selection of a test include: (1) content, empirical, and construct validity; (2)…

A liberal interpretation of Section 151 of Public Law 93-380, to implement effective local evaluation of Title I programs, is supported. Weaknesses are cited: (1) nationwide impact data, (2) unsound aggregation of Title I achievement gains, and (3) lack of consideration of alternative evaluation methods. (MH)

The general purposes of this study were to investigate the factorial validity of the Comprehensive Tests of Basic Skills (CTBS), Reading Comprehension subtest, and to study the item difficulties in order to determine areas of strengths and weaknesses of sixth and seventh grade Elementary Secondary Education Act (ESEA) Title I students. A sample of…

Title I Evaluation models using uniform procedures and data collection for state and national comparisons are interpreted as federal endorsement of basic, common competencies in reading and mathematics. Basic competencies, content homogeneity, conversion methodology, and validity of the evaluation are discussed. (MH)

The Behavior Rating Checklist (BRC) was developed in the Austin Independent School District to evaluate the counseling component in the Elementary Secondary Education Act Title I compensatory education programs for students in kindergarten through grade 5. The BRC was developed by: defining the behavior on which the counseling activities focused;…

The stated purpose of this study is to determine what pupil, teacher, and school district characteristics relate to young children's expressed attitudes as measured by the School Sentiment Index and to determine the usefulness of this measurement instrument. The subjects of the study were kindergarten through grade two children who received…

The three RMC models endorsed by the U.S. Office of Education for the evaluation of Elementary and Secondary Education Act Title I programs are based on narrowly conceived approaches to evaluation--the measurement of cognitive achievement gains. Each model requires the comparison of observed student performance with an estimate of what level of…