This paper focuses on certain technical aspects of reading-program evaluation, noting the differences in decision-making requirements and data-collection procedures between local administrators and State and Federal evaluators. The paper discusses the following differences in decision-making requirements: evaluating groups or individuals,…

This paper delineates several problems which arise when criterion-referenced test results are used to evaluate the effects of a specific educational treatment. Focus is on these topics: (1) the aggregation of individual students' data on objectives, (2) the sensitivity of the instrument to instruction, (3) the interpretation of…

The effectiveness of Mississippi's Assistant Teacher Program (ATP) was evaluated after its third year of operation, determining: (1) whether first graders who were exposed to teachers and assistant teachers who had been in ATP for three years continued to make progress in academic achievement; (2) the effectiveness of ATP in fostering achievement…

Threats to the validity of the Title I Evaluation and Reporting System are covered in two parts: an annotated bibliography of reports concerned with technical issues, and a discussion of threats to validity--from the reporting system in general and from each model in particular. Threats common to all three evaluation models are reported:…

The effectiveness of an Education Consolidation Improvement Act Chapter 1 program was studied in a large urban school district. A common problem in evaluating remedial programs is that pretest/posttest achievement gains often indicate the effects of the entire curriculum, rather than those specific to the remedial class. In this district, over…

This report documents the activities of the technical committee formed to examine issues related to the norm-referenced model (RMC Model A) for evaluation of Elementary and Secondary Education Act Title I programs. Background information is provided on the committee's activities, purpose, and meetings; and the members are listed. The reports of…

A norm-referenced achievement test, in combination with supplementary items, can be used to produce norm-referenced data as well as objective-referenced data. The experiences of the Palm Beach County (Florida) school district in developing and using such a test are described. (EGS)

A classical model for achievement test development was influenced by: the educational tradition of selecting a sample of questions appropriate to a subject and counting the proportion of acceptable responses; the emphasis on obtaining a large and homogeneous sample of questions to insure reliability; and the tradition in psychological testing of…

Many of the evaluations summarized in state and local Elementary and Secondary Education Act (ESEA) Title I reports have been negatively affected by methodological errors or the use of different, incompatible formats. Although new, detailed evaluation and reporting procedures have been developed for Title I research projects, two problems remain:…

Focusing on the use of the Metropolitan Achievement Test (MAT) with Project Follow Through evaluations, this report represents an extended discussion of the appropriateness of standardized tests for evaluation and policy research. First, the development of the MAT and its roots in the Army Alpha intelligence test are described in detail. The next…

Use of the Woodcock Reading Mastery Tests (WRMT), individually administered wide ranging reading tests, was explored, using Title I evaluation Models A1 and A2. Attention was focused on: (1) relationship of the Title I curriculum to the WRMT and the SRA Reading Test; (2) comparative reading achievement gains on both tests, using Model A1; and (3)…

Intended both to evaluate the California testing program's success in assessing student achievement in the basic skills and to suggest possible improvements in the program, this report includes an executive summary evaluating current testing procedures, describing experimental studies on new ways of testing and reporting testing information, and…

The orientation of this report is that of identifying educational projects which can be considered truly exemplary. The bulk of the report consists of a 23-step procedure for validating the effectiveness of educational programs using existing evaluation data. It is not intended as a guide for conducting evaluations but rather for interpreting data…

In this discussion of the use of achievement tests in evaluating Title I programs, matching content between test and curriculum is the main theme. The point is made that unless a test measures what is taught, it cannot be sensitive to whatever gains the instruction produces. Thus, if different instructional treatments have different objectives, it…

To reemphasize the dangers inherent in the misuse of testing instruments, a study of language and cognitive development in poverty preschoolers investigated 1) whether the interpretation of Peabody scores could be applied to this population, and 2) the contribution of the linguistic form of the Peabody to performance. (MS)