This study examined the impact of ITV intervention on reduction in the propensity to abuse substances and engage in drug trafficking. The researcher conducted this study using an experiment of 517 vulnerable adolescents aged 10-19 years. The participants were randomly assigned to control (n = 258) and treatment (n = 259) groups. The researchers…

As evidence-based interventions are scaled, fidelity of implementation, and thus effectiveness, often wanes. Validated fidelity measures can improve researchers' ability to attribute outcomes to the intervention and help practitioners feel more confident in implementing the intervention as intended. We aim to provide a model for the validation of…

Objective: This article describes the process implemented in order to define and build up a Basic Monitoring and Evaluation System for Spanish Cooperation's Culture and Development Strategy (CD-S). Research Design: Delphi techniques were used to assess a wide catalogue of indicators for each of the strategic areas included in the CD-S. Afterward,…

This study reports the results of the process evaluation component of the Process and Outcome Evaluation of the Gang Resistance Education and Training (G.R.E.A.T.) program. The process evaluation consisted of multiple methods to assess program fidelity: (a) observations of G.R.E.A.T. Officer Trainings (G.O.T); (b) surveys and interviews of…

Although widely available, little is known about the effectiveness of youth cessation treatments delivered in real-world settings. The authors recruited a nonprobability sample of 41 community-based group-format programs that treated at least 15 youth per year and included evidence-based treatment components. Data collection included longitudinal…

This paper discusses conceptual and methodological issues surrounding the measurement of the construct, degree of implementation, drawn from a review of 74 previous studies which included such measures. Assessments against five measurement criteria indicate that an adequate scientific bias has not been established for this construct. (Author/PN)

The purposes of this article are, first, to argue that analyses based on level of treatment implementation can lead to biased estimates of treatment effects, and second, to discuss alternatives to this approach. (PN)

The assumption of equal treatment implementation is questioned. Through the reanalysis of data from a nutrition supplementation program evaluation, the power of the analysis of treatment effects is shown to increase when data on the level of treatment implementation is included. (Author/CM)

After a brief discussion of the terms implementation and monitoring, this article illustrates a strategy for monitoring program implementation. The strategy, called model-guided method, offers a way to develop conceptual and empirical specifications for testing the adequacy of a program implementation. It also provides feedback to program…

The use of theoretical models in impact assessment can heighten the power of experimental designs and compensate for some deficiencies of quasi-experimental designs. Theoretical models of implementation processes are examined, arguing that these processes are a major obstacle to fully effective programs. (Author/CM)

An implementation analysis conducted as part of a two-year study of residential and nonresidential treatment programs for the dually diagnosed (psychiatric illness and substance abuse disorders) homeless (n=276) found significant differences in client engagement and retention and variations in treatment conditions. (SLD)

Describes a method for coding themes directly from audiotapes without transcription and issues and methods by which reliability can be established. A study of concerns of professionals being trained on 11 school-based support teams coded by 2 raters and based on 19 hours of audiotaped interviews illustrates the method. (SLD)

Federal evaluations in education contributed in numerous and important ways to changes in law, regulation, and management. Information about implementation contributed most often, but information about outcomes, cost, and federal administration also made contributions. These findings differ from previous research that concluded evaluations do not…

The lack of support for mental health-related projects by private philanthropy, even among those that express an interest in mental health, is due in large part to the subjectivity of the grant review process. To address this problem, Whaley, Rodriguez, and Alexander developed the Grant Proposal Rating Form (GPRF) to make the grant review process…

To explore the treatment fidelity of employee safety-belt programs, 614 organizations were divided into 2 groups: those that had (n=183), and those that had not (n=431) conducted an evaluation. Multiple regression analysis of associated data indicated that evaluation-active organizations were generally more active in other program areas. (TJH)