Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

This article presents a content analysis of the 2013 School Leadership Program (SLP) grants. SLP projects provide a unique opportunity for participants in the field to explore innovative leadership preparation and development and their impact on program participants, schools, school districts, and students. The article begins with an overview of…

Evaluation occurs within a specific context and is influenced by the economic, political, historical, and social forces that shape that context. The culture of evaluation is thus very much embedded in the culture of accountability that currently prevails in public sector institutions, policies, and program. As such, our understanding of the…

The Evidence-based Literacy Support-"Literacy Octopus" Trial tested a range of dissemination interventions and resources, all of which aimed to engage schools in using evidence-based materials to improve teaching and learning in Key Stage 2 literacy. Four delivery partners provided interventions. These included light-touch,…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Teachers are responsible for using evidence-based practices to improve students' academic and behavioral outcomes. Although teachers have access to a variety of resources on evidence-based practices, poor implementation can adversely affect their effectiveness. However, an inadequate student response to intervention may also be the result of…

In recent years, increased focus on the effectiveness and accountability of prevention and intervention programs has led to greater government funding for the implementation and spread of evidence-based health and human service delivery models. In particular, attention has been paid to programs that require significant infrastructure investment…

Implementation refers to the process by which an intervention is put into practice. Research studies across multiple disciplines, including education, have consistently demonstrated that interventions are rarely implemented as designed and, crucially, that variability in implementation is related to variability in the achievement of expected…

Educational evaluation in too many states and school districts, if done at all across an institution, has been reduced to crunching test scores in only the subject areas and grade levels tested. While measuring student achievement in reliable and valid ways is an important part of the mission of education, it is not enough. What's also needed is a…

This article addresses the leadership preparation line of inquiry developed in the past decade by the University Council for Educational Administration/Learning and Teaching in Educational Leadership Special Interest Group Taskforce on Evaluating Leadership Preparation Programs, and it particularly addresses the series of survey instruments…

Background: Return on investment (ROI) is one of the most popular evaluation metrics. ROI analysis (when applied correctly) is a powerful tool of evaluating existing information systems and making informed decisions on the acquisitions. However, practical use of the ROI is complicated by a number of uncertainties and controversies. The article…

New York's Cornell University spends millions of dollars and thousands of staff and volunteer hours to produce more than 1,400 events around the world each year. That's one event every six hours. Is it worth it? Do the 40,000 alumni, parents, and friends who attend feel closer to Cornell after these events? Do they disengage because Cornell didn't…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…

This article is an outgrowth of the evaluation and assessment process in a large interdisciplinary studies (IDS) program at West Virginia University. We argue for the importance of collecting and assessing quantitative and qualitative data concerning learning outcomes, student satisfaction, career choice and development, and graduate education…

Over the past decade and a half, state governments have assumed greater responsibility over demand-side management (DSM) operations. Whereas DSM programs formerly were initiated primarily by utilities or state public utility commissions, they are now becoming increasingly state-initiated and incentivized through funding mechanisms or…