Research on school leadership shows that principals can significantly impact student achievement by influencing classroom instruction, organizational conditions, community support and setting the teaching and learning conditions in schools. Moreover, strong principals provide a multiplier effect that enables improvement initiatives to succeed. The…

The value of a program can be understood as referring not only to outcomes, but also to how those outcomes compare to the types and amounts of resources expended to produce the outcomes. Major potential mistakes and biases in assessing the worth of resources consumed, as well as the value of outcomes produced, are explored. Most of these occur…

In this report the Brown Center on Education Policy at the Brookings Institution presents the results of a self-developed Education Choice and Competition Index (ECCI) along with an interactive application that grades large school districts according to the ECCI. The index is composed of 13 pro choice criteria. The authors present the ECCI as a…

This brief (1) defines indicators, (2) places the concept into the context of the various ways indicators can be used in education, (3) explores some specific considerations and concerns that arise in evaluating results, (4) offers a categorization and examples of short-term outcome indicators for school use, and (5) stresses the need for policy…

After months of waiting, the grant reviews came back: "excellent," "excellent," and "fair." What?! How can this be? Why is the third review so out of line with the first two? On more than one occasion a principal investigator (PI) has been frustrated not only by a negative funding decision but more so by the accompanying reviewer evaluation forms…

This paper contains results of an empirical study that tested the efficacy and acceptability of two templates designed to fully involve students in proper and fair peer-assessments of their group project work (GPW) by providing concrete evidence of independent progressive documentation of their peers' contributions to the work-process and…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

A large body of literature documents the central importance of fidelity of program implementation in creating an internally valid research design and considering such fidelity in judgments of research quality. The What Works Clearinghouse (WWC) provides web-based summary ratings of educational innovations and is the only rating group that is…

The role and methods of an evaluator of program effectiveness are discussed. Responses to questions prepared by academicians were obtained from three evaluation practitioners; an external, independent evaluator; and an internal evaluator with program implementation responsibilities. Practitioners uniformly indicated that internal evaluators were…

While the current debate in the evaluation community has concentrated on examining and explicating implications of the choice of methods for evaluating federal programs, the authors of this paper address the challenges faced by the government in the selection of funding mechanisms for supporting program evaluation efforts. The choice of funding…

In compliance with California's Proposition 10 (Children and Families First Act), county commissions are being asked to monitor what differences the family support programs they are funding are making in the lives of the children and families they serve. Each commission has the responsibility of selecting a set of indicators to measure the impact…

Kirkpatrick's highly popular model of training evaluation criteria proposed four ascending, causally related, and positively intercorrelated levels: reactions, learning, behavior, and results. This article examines the validity of the three problematic assumptions of the model, the frequency of each level in published evaluation studies,…

Family resource centers (FRC) are emerging as a promising program approach to solving urgent social problems. Evaluation plays an important role in learning how these programs work, what their impact is, and whether they should be expanded. However, FRCs pose unique challenges to evaluation. This report considers the challenges to evaluating FRCs,…

Examines principles to consider when evaluating the impact of outdoor-based experiences, including developing a rationale for the evaluation, determining the emphasis of the evaluation, and applying appropriate criteria to the evaluation process. Discusses difficulties associated with control groups, sampling bias, time period of evaluation, and…

Described is a rationale and process that can be used for the evaluation of environmental education programs. Expectations, planning, results, and using results are all discussed as steps in the evaluation process. (CW)