A research design is described for the situation in which a program, particularly a compensatory education program funded by Chapter 1 of the Hawkins Stafford Act of 1988, can be evaluated when there is no available comparison group and no pretest data. The design requires content specialists to identify which objectives on the posttest were…

The one group posttest only evaluation model has been identified as a relatively inexpensive and useful model that can identify program components that are not being successful. The use of the model is discussed and illustrated through a hypothetical evaluation of a compensatory (Chapter 1) program. The one group posttest only evaluation model…

This paper addresses methodological and substantive issues regarding the use of portfolios of students' work in Chapter 1 evaluation and program improvement. In evaluations using portfolios desirable characteristics of the evaluation procedure are objectivity, reliability, and validity. The Chapter 1 Evaluation/Program Improvement System (CHEPIS)…

The experience of the research and evaluation department in the Dallas (Texas) Independent School District in pioneering the use of a policy-oriented report to communicate evaluation findings is described. The report--the chart essay--replaced a methods-oriented report. In restructuring the methods-oriented report into a policy-oriented report,…

The purpose of this pilot study was to investigate the relationship between achievement, teacher-reported letter grades, and instructional levels in a sample of 100 Chapter 1 students who had participated in the program for two years. For each student, third grade and fifth grade California Achievement Test scores, end-of-year letter grades, and…

This paper examines whether the Title I/Chapter 1 tradition of leading the way in educational evaluation will continue or whether Chapter 1 will change its role by delegating decision-making authority over evaluation methodology to state and local school systems. Whatever direction Chapter 1 takes, states, school systems, and schools must be held…

Often there is a desire to evaluate a program, but there is no comparable comparison group available. This paper focuses on an evaluation model that can be used when there is no comparison group and when there is no pretest. The method--Model A--used by the Chapter 1 compensatory education program is described. Model A, which uses a…

Valid indicators for a school district's Chapter 1 program that would help districts make decisions and shape policy are defined and explored. The March 1988 report of the School District of Philadelphia's Chapter 1 task force proposed a 2-year phase-in of a totally restructured Chapter 1 program for the Philadelphia schools. The definition of…

This paper describes: the development and implementation of Schoolwide Projects (SWPs) in the School District of Philadelphia (Pennsylvania); evaluation models permitted by Chapter 1 regulation and policy; ways these models were used in Philadelphia and results that were obtained; and approaches that are sensitive to the effects of SWPs. The…

Like the Elementary Secondary Education Act Title I, the Education Consolidation Improvement Act Chapter 1 requires school districts to determine at least once every 3 years whether Title I achievement gains are sustained over a period of 12 months or more. A local education agency (LEA) has considerable flexibility in the approach it takes in…

At the request of the Oklahoma Department of Education, the Technical Assistance Center 3 West conducted a statewide review of local Chapter 1 evaluation data to provide possible explanations for the unusual standardized test score gains or losses reported by a number of local school districts. During the two months of quality control visits, 35…

In response to growing frustration over the lack of information about the national effectiveness of the Chapter 1 program, Congress enacted the Education Amendments of 1974. Section 151 of the Amendments directed the U.S. Office of Education to develop evaluation models that would allow school district data to be aggregated to provide national…

The effectiveness of an Education Consolidation Improvement Act Chapter 1 program was studied in a large urban school district. A common problem in evaluating remedial programs is that pretest/posttest achievement gains often indicate the effects of the entire curriculum, rather than those specific to the remedial class. In this district, over…

Technical problems with norm-referenced achievement testing that can lead to the erroneous evaluation of schools for Chapter 1 Program improvement is discussed, and an alternative testing model is presented. The history of Chapter 1 testing and evaluation policies is briefly reviewed, and problems with the norm-referenced model are explored. Data…

This paper traces the evaluation requirements of the Title I/Chapter 1 Program since 1966 to the present, discusses the implications of the evaluations, and reports on the evolution of evaluation during this 20 year period. The evaluations are described in four phases: (1) from a nadir of low quality, utility and precision (1966-1974); (2) to a…