Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

This article presents a content analysis of the 2013 School Leadership Program (SLP) grants. SLP projects provide a unique opportunity for participants in the field to explore innovative leadership preparation and development and their impact on program participants, schools, school districts, and students. The article begins with an overview of…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Teachers are responsible for using evidence-based practices to improve students' academic and behavioral outcomes. Although teachers have access to a variety of resources on evidence-based practices, poor implementation can adversely affect their effectiveness. However, an inadequate student response to intervention may also be the result of…

In recent years, increased focus on the effectiveness and accountability of prevention and intervention programs has led to greater government funding for the implementation and spread of evidence-based health and human service delivery models. In particular, attention has been paid to programs that require significant infrastructure investment…

Educational evaluation in too many states and school districts, if done at all across an institution, has been reduced to crunching test scores in only the subject areas and grade levels tested. While measuring student achievement in reliable and valid ways is an important part of the mission of education, it is not enough. What's also needed is a…

This article addresses the leadership preparation line of inquiry developed in the past decade by the University Council for Educational Administration/Learning and Teaching in Educational Leadership Special Interest Group Taskforce on Evaluating Leadership Preparation Programs, and it particularly addresses the series of survey instruments…

Background: Return on investment (ROI) is one of the most popular evaluation metrics. ROI analysis (when applied correctly) is a powerful tool of evaluating existing information systems and making informed decisions on the acquisitions. However, practical use of the ROI is complicated by a number of uncertainties and controversies. The article…

New York's Cornell University spends millions of dollars and thousands of staff and volunteer hours to produce more than 1,400 events around the world each year. That's one event every six hours. Is it worth it? Do the 40,000 alumni, parents, and friends who attend feel closer to Cornell after these events? Do they disengage because Cornell didn't…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

When measuring outcomes in corporate training, the authors recommend that it is essential to introduce a comprehensive plan, especially when resources are limited and the company needs are vast. The authors hone in on five critical components for shaping a measurement plan to determine the success and ROI of training. The plan's components should…

Students helping students have become an increasingly important educational concept over the last 20 years. While the popularity and prevalence of these types of programs have grown considerably, there has been little effort to evaluate their effectiveness. The authors advocate for counselors to use a scientist practitioner approach to…

Available designs and instruments for evaluation are not adequate to meet the varied needs of evaluation. Therefore, evaluation needs to be reshaped in terms of 1) consideration of how and where currently available theories, designs, and instruments are proving useful, 2) identification of needs that cannot be met ith currently available…

The relative utilities of subjectivity and objectivity in educational evaluation are debated. Page supports objectivity, while Stake supports subjectivity. (JKS)