Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

The Evidence-based Literacy Support-"Literacy Octopus" Trial tested a range of dissemination interventions and resources, all of which aimed to engage schools in using evidence-based materials to improve teaching and learning in Key Stage 2 literacy. Four delivery partners provided interventions. These included light-touch,…

Teachers are responsible for using evidence-based practices to improve students' academic and behavioral outcomes. Although teachers have access to a variety of resources on evidence-based practices, poor implementation can adversely affect their effectiveness. However, an inadequate student response to intervention may also be the result of…

Implementation refers to the process by which an intervention is put into practice. Research studies across multiple disciplines, including education, have consistently demonstrated that interventions are rarely implemented as designed and, crucially, that variability in implementation is related to variability in the achievement of expected…

Educational evaluation in too many states and school districts, if done at all across an institution, has been reduced to crunching test scores in only the subject areas and grade levels tested. While measuring student achievement in reliable and valid ways is an important part of the mission of education, it is not enough. What's also needed is a…

New York's Cornell University spends millions of dollars and thousands of staff and volunteer hours to produce more than 1,400 events around the world each year. That's one event every six hours. Is it worth it? Do the 40,000 alumni, parents, and friends who attend feel closer to Cornell after these events? Do they disengage because Cornell didn't…

Over the past decade and a half, state governments have assumed greater responsibility over demand-side management (DSM) operations. Whereas DSM programs formerly were initiated primarily by utilities or state public utility commissions, they are now becoming increasingly state-initiated and incentivized through funding mechanisms or…

When measuring outcomes in corporate training, the authors recommend that it is essential to introduce a comprehensive plan, especially when resources are limited and the company needs are vast. The authors hone in on five critical components for shaping a measurement plan to determine the success and ROI of training. The plan's components should…

This is the final report of the National Evaluation of Student Support Services (SSS). SSS is one of eight federally funded grant programs that are administered as part of the Federal TRIO Programs within the U.S. Department of Education (ED). The SSS program, in particular, focuses on students while they are enrolled in college. In general, SSS…

Offering a primer on action research methodologies and examples of practice, "Students in Transition: Research and Practice in Career Development" responds to a dual challenge facing career development educators--designing cutting-edge career development interventions and demonstrating their effectiveness. Overviews of quantitative and qualitative…

Students helping students have become an increasingly important educational concept over the last 20 years. While the popularity and prevalence of these types of programs have grown considerably, there has been little effort to evaluate their effectiveness. The authors advocate for counselors to use a scientist practitioner approach to…

Evaluation design decisions for a child care provider training program are discussed as a function of three characteristics: decentralization, local autonomy and multiple delivery strategies. While decentralized process data were gathered, only centralized outcome data were collected. The design decisions made were appropriate for such diverse…

This study attempts to clarify some of the issues involved in defining the effectiveness of compensatory education programs. It discusses the extent to which conclusions about the effectiveness of compensatory education programs are affected by two major components of an evaluation: the period of time on which the evaluation is based and the…

The estimation of the "size of effect" of educational programs is a difficult problem in program evaluation. It is argued that the intentions of the program and the nature of the measures must be known in order to estimate program effects. (JKS)