Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

This article presents a content analysis of the 2013 School Leadership Program (SLP) grants. SLP projects provide a unique opportunity for participants in the field to explore innovative leadership preparation and development and their impact on program participants, schools, school districts, and students. The article begins with an overview of…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Educational evaluation in too many states and school districts, if done at all across an institution, has been reduced to crunching test scores in only the subject areas and grade levels tested. While measuring student achievement in reliable and valid ways is an important part of the mission of education, it is not enough. What's also needed is a…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

Over the past decade and a half, state governments have assumed greater responsibility over demand-side management (DSM) operations. Whereas DSM programs formerly were initiated primarily by utilities or state public utility commissions, they are now becoming increasingly state-initiated and incentivized through funding mechanisms or…

When measuring outcomes in corporate training, the authors recommend that it is essential to introduce a comprehensive plan, especially when resources are limited and the company needs are vast. The authors hone in on five critical components for shaping a measurement plan to determine the success and ROI of training. The plan's components should…

Based on Strasser and Deniston's guidelines (TM 504 251), the author discusses pre-planned and post-planned program evaluation decisions based on: (1) attitude of the organization being evaluated; (2) availability of resources; and (3) usefulness of the findings for programmatic decision making. (MH)

Follow-up studies are necessary for investigating the long-term, enduring, anticipated effects of bilingual education. Investigations need to be based on a recognition of their value to educational audiences, the relative merits of research issues, attention to the problem of attrition, proper selection of dependent measures, and the merits of…

This guide was designed for trainers presenting inservice workshops for program evaluators, teachers, principals, curriculum specialists, and others responsible for school programs. It is keyed to a companion volume, the Program Evaluator's Guide (ED l42 563), the primary source for workshop participants. Developed under the California Evaluation…

A model for research and evaluation in outdoor education is presented in this paper which includes a bibliography of representative research in outdoor, experiential education. The model stresses close interaction between program designers and evaluators and rests on the premise that the strength of outdoor education--interaction between people,…

In this discussion of the use of achievement tests in evaluating Title I programs, matching content between test and curriculum is the main theme. The point is made that unless a test measures what is taught, it cannot be sensitive to whatever gains the instruction produces. Thus, if different instructional treatments have different objectives, it…