This paper compares and contrasts the program theory of the reenacted Supervision Act to the Supervision Act of 2003. We describe how the expectations about how schools should be inspected, the effect such inspections are expected to have, and how these effects should be realized have changed over the past years as a result of changing paradigms…

A sample of educational evaluators was asked to design an outcomes-focused evaluation of a school program that aims to improve the academic achievement and self-esteem of students. Evaluators provided detailed descriptions of their evaluation design and methodology in their responses. These descriptions were coded and analyzed to determine the…

To what extent does the intense and direct involvement of internal stakeholders, such as program managers and staff members, play a significant role toward evaluation use? Stakeholder involvement is a key element in evaluation and evaluation use is considered within a broader sense that includes organizational knowledge, individual skills, and…

An abundance of comprehensive school reform (CSR) literature exists illustrating CSRs are effective in improving student outcomes. However, much of this research reports on top-down reforms, focuses on academic outcomes, and uses quantitative methods alone. Many educational researchers have argued for the use of mixed methods for providing a…

Notwithstanding significant efforts by international aid agencies, aid ineffectiveness became apparent in 1990s as the impact of continued development intervention did not endure the expected outcomes. Conventional monitoring and evaluation by those agencies is critiqued for focusing on measuring project outcomes and giving little attention to…

In many European languages, the words "assessment" and "evaluation" are synonymous, but in English the two terms are used differently. Educational "assessment" is learner-focused and part of professional pedagogy, relating directly to the accountability of practitioners and schools to learners and their families.…

This paper synthesizes the existing literature on stakeholder involvement in program evaluation, drawing a basic distinction between deep involvement of a few versus less active involvement of a broad range of stakeholders. The paper then comments on the case studies described in this special issue and integrates them with previously published…

Using a cross-case analysis of three distinct participatory program evaluations, this paper contributes to current discourse on how evaluators create opportunities for learning. Although each team of evaluators intended to promote planned process use, post-evaluation discussions amongst them identified evidence where use emerged throughout the…

This article describes an effectiveness evaluation of an intensive case management intervention coordinated by a non-profit organization in a midsize Midwest City. As an effectiveness evaluation, the primary evaluation question was causal in nature; the key task of the evaluative study was to establish and probe connections between the…

In this essay, we describe our experiences working with a rebellious primary stakeholder, Sylvia, as evaluators of a district-wide safe schools program. Given the breadth of the program and its multiple target constituencies, we were confronted with the challenges of managing a large number of stakeholders, or those individuals and groups that…

This chapter describes evaluator behaviors revealed by the case analysis of a participatory and developmental evaluation. The analysis revealed that the evaluator paid specific attention to individual stakeholder cues. These cues were related to three elements of the evaluation: negotiating the design, monitoring individual stakeholder needs, and…

The purpose of this article is to describe a new approach for conducting multi-site evaluations of professional development (PD). The approach extends a popular model of PD evaluation through the creation of individual project profiles that take into account the unique contextual variables of individual projects while providing an evaluation…

The problem of bullying has gained attention in recent years. Schools are investing significant resources into antibullying programs, despite scant evidence of program effectiveness. Three hundred ninety-five schools responded to a province-wide survey, whose purpose was (a) to describe the evaluation activities of schools relative to their…

Makes the case that both internal and external evaluation are needed in the assessment of educational systems. Suggests some conditions have to be met to establish a constructive dialogue between internal and external evaluation. (SLD)

The portfolio approach to self-evaluation is possible with limited staff time or funds. Evaluators collect a variety of documents and records that describe the goals, perceptions and values involved in the program. The portfolio items should represent key issues and precipitate useful discussions. (GDC)