Objective: This article describes the process implemented in order to define and build up a Basic Monitoring and Evaluation System for Spanish Cooperation's Culture and Development Strategy (CD-S). Research Design: Delphi techniques were used to assess a wide catalogue of indicators for each of the strategic areas included in the CD-S. Afterward,…

In contrast to the prevailing image of monitoring systems as technical systems, it is proposed that they should rather be conceived of as social endeavors at exchanging information. Drawing on the monitoring and evaluation framework of Cornford, Doukidis, and Forster, the concept of information agreement is suggested as a way of assessing the…

This paper discusses conceptual and methodological issues surrounding the measurement of the construct, degree of implementation, drawn from a review of 74 previous studies which included such measures. Assessments against five measurement criteria indicate that an adequate scientific bias has not been established for this construct. (Author/PN)

Previous research on program implementation is integrated and extended to form a participatory approach to evaluating program implementation. This method focuses on the continuous active involvement of program developers, managers, and staff in the evaluation process. The methodology is applied to an actual program to highlight the steps involved.…

The purposes of this article are, first, to argue that analyses based on level of treatment implementation can lead to biased estimates of treatment effects, and second, to discuss alternatives to this approach. (PN)

The assumption of equal treatment implementation is questioned. Through the reanalysis of data from a nutrition supplementation program evaluation, the power of the analysis of treatment effects is shown to increase when data on the level of treatment implementation is included. (Author/CM)

After a brief discussion of the terms implementation and monitoring, this article illustrates a strategy for monitoring program implementation. The strategy, called model-guided method, offers a way to develop conceptual and empirical specifications for testing the adequacy of a program implementation. It also provides feedback to program…

The use of theoretical models in impact assessment can heighten the power of experimental designs and compensate for some deficiencies of quasi-experimental designs. Theoretical models of implementation processes are examined, arguing that these processes are a major obstacle to fully effective programs. (Author/CM)

Federal evaluations in education contributed in numerous and important ways to changes in law, regulation, and management. Information about implementation contributed most often, but information about outcomes, cost, and federal administration also made contributions. These findings differ from previous research that concluded evaluations do not…

Four steps to curriculum innovation are outlined: (1) identifying descriptive dimensions; (2) specifying practices implied by the innovation; (3) describing actual practices; and (4) comparing actual with intended practices across the critical dimensions of beliefs, objectives, instructional materials, and teaching strategies. (Author/CP)

Presents preliminary evaluation findings from Florida's Juvenile Justice Educational Enhancement Program that explore the relationships between educational program quality and program characteristics. Several program characteristics are found to be related to measurements of educational program quality, including proportion of teachers who are…

A methodology is presented for collection of cost data in evaluation of community-level health interventions that coincides with the intervention implementation. The seven discrete steps of the analysis are described, and the Minimal Contact Education for Cholesterol Change study is used as an example of how the strategy is used. (SLD)

Provides an overview and a context leading to Florida's efforts to implement an evaluation-driven research and associated quality assurance system for its juvenile justice education policies and practices. The Juvenile Justice Educational Enhancement Program described began implementing Florida's evaluation research and quality assurance system in…

Describes two stages of the Juvenile Justice Educational Enhancement Program's pre-, post-, and longitudinal evaluation research and reports on the pilot studies used to explore how to design statewide research on pre- and post-assessment scores and community reintegration outcomes. Findings suggest that higher performing programs produce greater…

Discusses the evaluation of juvenile justice education through Florida's Juvenile Justice Educational Enhancement Program as it involves the integration of multiple data sources. Examines the methodological, political, and bureaucratic obstacles encountered in the development of this evaluation system. (SLD)