This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

The purposes of this article are, first, to argue that analyses based on level of treatment implementation can lead to biased estimates of treatment effects, and second, to discuss alternatives to this approach. (PN)

External and implementation factors and their potential threats to field test validity and the practical realities of the field testing process on results are discussed. External factors include site selection, negotiations, contracts, site monitoring, training, and type of product. Implementation factors include motivation, dependence on local…

Stakeholder-based studies modify the relationship between evaluator and user, producing conflict that can cause evaluators to regress to familiar, traditional patterns that leave interactive evaluation strategies only partially implemented. (Author/PN)

Analysis of the assumptions underlying the stakeholder approach to evaluation combined with the limited experience in testing the approach reported in this volume, suggests that some claims are cogent and others problematical. (Author)

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

The evaluators of Push/Excel assumed that it was a systematically developed program with measurable outcomes, not a charismatically inspired movement whose effects would be hard to pin down. As a result, neither the program nor the evaluation approach used were adequately tested. (Author)

The evaluation of the reading programs in the Eugene, Oregon, public schools is described. Emphasis is placed on the eclectic approach to reading in the district prior to the evaluation and on the effect of using staff members as evaluators in their own district. (CTM)

Measuring cognitive achievement gains in project evaluation is dealt with. This guide provides those concerned with project evaluation with the basic tools for conducting technically sound, interpretable evaluation studies. Exotic designs are avoided and five basic models which appear feasible to implement in real-world settings are focused on.…