Treatment integrity (also referred to as "treatment fidelity," "intervention integrity," and "procedural reliability") is an important methodological concerning both research and practice because treatment integrity data are essential to making valid conclusions regarding treatment outcomes. Despite its relationship to validity, treatment…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Purpose: The use of e-learning is largely predicated upon the assumption that it can facilitate improvements in student learning and therefore can be more effective than conventional techniques. This assumption has been supported by some in the literature but has been questioned by a continuing body of contrary or indifferent evidence. The purpose…

Professional evaluators are often called upon to analyze data produced by a catastrophically inadequate evaluation design. A remedial strategy involving diagnosis of error, application of a corrective procedure and sensitization of program personnel of the need for a more sophisticated stance, is proposed and illustrated with a case study.…

The choice between experimental research or process-oriented oriented research as the only valid paradigm of evaluation research is rejected. It is argued that there is a middle ground. Suggestions are made for mixing the two approaches to suit particular research settings. (Author/GK)

Documenting treatment integrity is an important issue in research and practice in any discipline concerned with prevention and intervention. However, consensus concerning the dimensions of treatment integrity and how they should be measured has yet to emerge. Advances from three areas in which significant treatment integrity work has taken…

The concept of treatment integrity cuts across a diversity of fields involved with providing treatments or interventions to individuals. In medical treatments, the concept of "treatment compliance" or "treatment adherence" is an important and problematic issue. In the field of nutrition, the concept of "dietary adherence" is important for…

The story of the national evaluation of the Follow Through program mirrors the difficulties in trying to evaluate a complex social program that changed its community service orientation to a strategy of planned variation of early childhood programs. (Author/MLF)

This paper focuses on transition programs for youth to postsecondary education, broadly considered. It addresses the following questions: (1) What models or programs of transition exist? (2) On what basis can we say one transition program is more effective than another? In other words, how is successful transition defined? (3) How are…

Prior to graduating from high school, the vast majority of youth in the United States will take part in at least one community service activity. Although it is frequently assumed that community service is inherently beneficial to those that take part, the activities and processes of youth service programs tend to be unsystematic and vary widely.…

Egon G. Guba and Yvonna S. Lincoln were among the first to develop a set of extensive criteria for establishing naturalistic inquiry as a disciplined research methodology. The naturalistic paradigm--also called post-positivist, ethnographic, phenomenological, and qualitative--has gained acceptance as a legitimate alternative to the previously…

Hypothesis generation and testing is outlined as an additional domain for program evaluators. Program evaluation involves a thorough analysis of the processes that contribute to change (or a lack of change) among program recipients. This process of change is analyzed in two ways: (1) treating programs as naturally occurring field studies; and (2)…

Data from 86 Early Childhood Education (ECE) projects in Oregon were analyzed using methods prescribed by the Value Added model for ECE evaluation. The extent to which appropriate model implementation procedures were followed is unknown. Thus, the results represent an empirical account of the model's estimates of project impact, rather than a…

Abt Associates, the firm responsible for the primary analysis of the Follow Through experiment, summarize the findings. Their clearest finding indicates that local circumstances, attitudes, and activities unmeasured by evaluation have much more to do with the effectiveness of Follow Through models, without exception, than do their theoretical…