This guide will help researchers design and implement impact studies in education so that the findings are more generalizable to the study's target population. Guidance is provided on key steps that researchers can take, including defining the target population, selecting a sample of schools--and replacement schools, when needed--managing school…

This report focuses on the progress made and challenges faced by the nine states in achieving the first three objectives for which they were held accountable for use of their Race to the Top Early Learning Challenge (RTTELC) funds. It discusses discrete findings related to these objectives in relevant chapters of the report: Tiered Quality Rating…

The "Race to the Top" competitive grant program initiated a wave of teacher evaluation reform, which scholars and policymakers have long identified as critical to improving teacher quality and student performance. State boards of education (SBEs) and state education agencies (SEAs) took different approaches to these reforms, and as a…

Instruments for evaluating the implementation of inquiry science in K-12 classrooms are necessary if evaluators and researchers are to know the extent to which programs are implemented as intended and the extent to which inquiry science teaching accounts for student learning. For evaluators and researchers to be confident about the quality of…

In a simulated adversary-advocacy evaluation of a computer-assisted school guidance program, the evaluation audience's reaction to different forms of data, the order of argument presentations, and the rated attitude of the evaluator are shown to influence audience agreement with evaluation recommendations. (CM)

An approach to evaluation initiated by the Kellogg Foundation called cluster evaluation (not to be confused with cluster sampling) is described. Cluster evaluation provides a skilled, credible evaluator to work with a cluster of projects to assure that useful and defensible information is obtained for program evaluation. (SLD)

A survey covered categories of budget, organization, staff resources, activities, and reporting techniques and policies; the survey revealed Research and Evaluation (R and E) offices received federal or state funding. Therefore, most retain financial independence from programs evaluated. The best placement of R and E offices in the school…

This manual was prepared to assist in the development of skills requisite to rating the performance of student or beginning teachers. The activities prescribed in the manual are intended to enable experienced teachers to describe the spectrum of performances indicative of the 18 competencies subsumed in the Teacher Performance Assessment…

One of a series of reports concerned with the creation of new evaluation methodologies for use in education, this report contains a collection of thirteen brief statements of problems encountered first-hand by evaluation practitioners in state departments of education (SEAs). Its intent is to make available practitioner statements so that further…

Evaluators usually assume that the data they receive are valid, or at least, that the data reflect that which is being evaluated. In a recent evaluation in a large southern school district, evaluators compared their raw interview notes with interview notes edited by the teachers interviewed or project staff. The program evaluated was Project SEED,…

Difficulties faced in evaluations that include data in a language not native to the evaluators or that lie outside the evaluators' cultural experience are discussed. Improvements to credibility and fairness from using a cross-cultural, bilingual evaluation are described and illustrated through evaluation of a language immersion program in Hawaii.…

A standard-setting procedure was developed for the Georgia Teacher Certification Testing Program as tests in 30 teaching fields were revised. A list of important characteristics of a standard-setting procedure was derived, drawing on the work of R. A. Berk (1986). The best method was found to be a highly formalized judgmental, empirical Angoff…

This paper describes the practical steps employed in controlling interview data generated from a research project investigating teachers' perspectives on the worth of a sex equity educational demonstration project. These perspectives were then considered as value frameworks that might be used to formulate and interpret a naturalistic-responsive…

A case study approach was used to evaluate the statewide reading improvement project in Louisiana called Special Plan Upgrading Reading (SPUR). SPUR emphasized a change agent approach by providing Technical Assistants and small stipends (approximately $5,000) to participating school districts. During the first two years of the evaluation,…

The Minneapolis Experimental Schools Project (Southeast Alternatives)--a five-year program established in 1971 to test comprehensive change in education--enrolls 2,200 K-12 students, approximately 4% of the public school population. Southeast Alternatives (SEA) is dedicated to four major goals: (1) to provide a curriculum which helps children…