As evidence-based interventions are scaled, fidelity of implementation, and thus effectiveness, often wanes. Validated fidelity measures can improve researchers' ability to attribute outcomes to the intervention and help practitioners feel more confident in implementing the intervention as intended. We aim to provide a model for the validation of…

This study tested a 'wise' intervention (quick prompt of a specific psychological mec) in acute care hospital units to improve nurses' hand hygiene compliance (HHC). A multiple baseline design in two medical-surgical teaching hospitals in the United States. Hand hygiene data was collected using an electronic compliance monitoring system with…

This study examined the impact of ITV intervention on reduction in the propensity to abuse substances and engage in drug trafficking. The researcher conducted this study using an experiment of 517 vulnerable adolescents aged 10-19 years. The participants were randomly assigned to control (n = 258) and treatment (n = 259) groups. The researchers…

Background: The dominant theoretical basis of our public health practice originates from a positivist or reductionist paradigm. It fails to take into account the complexity emerging out of public health's multiple influences originating from biological and social worlds. A deeper understanding of the interaction of elements that characterize the…

Evaluation designs for social programs are developed assuming minimal or no disruption from external shocks, such as natural disasters. This is because extremely rare shocks may not make it worthwhile to account for them in the design. Among extreme shocks is the 2010 Chile earthquake. Un Buen Comienzo (UBC), an ongoing early childhood program in…

Objective: This article describes the process implemented in order to define and build up a Basic Monitoring and Evaluation System for Spanish Cooperation's Culture and Development Strategy (CD-S). Research Design: Delphi techniques were used to assess a wide catalogue of indicators for each of the strategic areas included in the CD-S. Afterward,…

Although widely available, little is known about the effectiveness of youth cessation treatments delivered in real-world settings. The authors recruited a nonprobability sample of 41 community-based group-format programs that treated at least 15 youth per year and included evidence-based treatment components. Data collection included longitudinal…

This study reports the results of the process evaluation component of the Process and Outcome Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) program. The process evaluation consisted of multiple methods to assess program fidelity: (a) observations of G.R.E.A.T. Officer Trainings (G.O.T); (b) surveys and interviews of…

This paper describes a six-month service-coordination pilot project (SCPP) designed to improve coordination activities among mental health service providers in a Canadian city. The aim of the project was to improve information sharing and joint treatment planning. Data show no effect of the SCPP, but service providers perceived improvements. (TJH)

Previous research on program implementation is integrated and extended to form a participatory approach to evaluating program implementation. This method focuses on the continuous active involvement of program developers, managers, and staff in the evaluation process. The methodology is applied to an actual program to highlight the steps involved.…

Presents a case study of the development and implementation of the "results framework," an innovative planning and evaluation tool that is becoming a standard for U.S. Agency for International Development projects. Explains the advantages of this evaluation and monitoring approach. (SLD)

In 2003, the Office of Juvenile Justice and Delinquency Prevention (OJJDP) provided Florida's Department of Juvenile Justice (DJJ) with a $3.5 million grant to design and implement a faith- and community-based program for incarcerated juveniles. Florida's experience developing a completely new program has provided valuable lessons regarding…

After a brief discussion of the terms implementation and monitoring, this article illustrates a strategy for monitoring program implementation. The strategy, called model-guided method, offers a way to develop conceptual and empirical specifications for testing the adequacy of a program implementation. It also provides feedback to program…

A survey of 43 high school principals about the usefulness of feedback reports generated through the evaluation of the Henry J. Kaiser Family Foundation's Community Health Promotion Grants Program suggests that principals found the reports very valuable in a number of ways, especially in designing and implementing programs. (SLD)

In contrast to the prevailing image of monitoring systems as technical systems, it is proposed that they should rather be conceived of as social endeavors at exchanging information. Drawing on the monitoring and evaluation framework of Cornford, Doukidis, and Forster, the concept of information agreement is suggested as a way of assessing the…