Title I accountability requirements under the Every Student Succeeds Act (ESSA) represent the present-day instantiation of Lau, which requires schools to provide a program for English learners (ELs) that supports their meaningful engagement and to provide transparent information about EL program quality. This study uses critical policy analysis to…

Threats to the validity of the Title I Evaluation and Reporting System are covered in two parts: an annotated bibliography of reports concerned with technical issues, and a discussion of threats to validity--from the reporting system in general and from each model in particular. Threats common to all three evaluation models are reported:…

Measurement terms used in Title I evaluation are contained in this glossary. Several types of measurement techniques are identified and defined. Other measurement terms which are defined include those relating to validity, reliability, statistical analysis, test interpretation, and program effectiveness. (DWH)

In this discussion of the use of achievement tests in evaluating Title I programs, matching content between test and curriculum is the main theme. The point is made that unless a test measures what is taught, it cannot be sensitive to whatever gains the instruction produces. Thus, if different instructional treatments have different objectives, it…

Some early childhood variables are examined to evaluate their predictive validity. The selection of children needing early childhood Title I services is complicated by the lack of criteria for defining who is educationally disadvantaged and the special problems of early childhood testing and measurement. The study used re-analysis of longitudinal…

The Normal Curve Equivalent (NCE) gain statistic is examined, and considerations for its interpretation are highlighted. The NCE gain is made up of an observed and an expected part. The observed score is the posttest result. The expected score can never be observed nor verified for any of the Title I Evaluation and Reporting System (TIERS) models;…

The tenability of the equipercentile growth assumption was investigated. This assumption is the basis of the norm referenced evaluation model (Model A) for Title I program evaluations, and supposes that a cohort of students, given no special educational intervention, will maintain the same percentile rank over the course of a school year, as…

The internal validity of the RMC models, especially Model A, is examined. Concern centers on limiting evaluation to cognitive outcomes, using constant percentile as the no-treatment expectation, and using norms for one test to establish the expected no-treatment performance level for another test. (MH)

Two ESEA Title I evaluation models developed by the Resource Management Corporation (RMC), were field tested simultaneously with 560 Title I reading students, grades 2-8. Measuring instruments for models 1 and 2 were, respectively, the California Achievement Test (reading vocabulary section), a norm-referenced test; and the Tarmac Reading…

A liberal interpretation of Section 151 of Public Law 93-380, to implement effective local evaluation of Title I programs, is supported. Weaknesses are cited: (1) nationwide impact data, (2) unsound aggregation of Title I achievement gains, and (3) lack of consideration of alternative evaluation methods. (MH)

Title I Evaluation models using uniform procedures and data collection for state and national comparisons are interpreted as federal endorsement of basic, common competencies in reading and mathematics. Basic competencies, content homogeneity, conversion methodology, and validity of the evaluation are discussed. (MH)

The Behavior Rating Checklist (BRC) was developed in the Austin Independent School District to evaluate the counseling component in the Elementary Secondary Education Act Title I compensatory education programs for students in kindergarten through grade 5. The BRC was developed by: defining the behavior on which the counseling activities focused;…

The three RMC models endorsed by the U.S. Office of Education for the evaluation of Elementary and Secondary Education Act Title I programs are based on narrowly conceived approaches to evaluation--the measurement of cognitive achievement gains. Each model requires the comparison of observed student performance with an estimate of what level of…