Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

This document provides guidance about how to describe studies and report their findings in a way that is clear, complete, and transparent. This document does not include information about how studies are judged against What Works Clearinghouse evidence standards. For information about What Works Clearinghouse evidence standards, please refer to…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

Increasing demands for evidence-based early childhood services and the need by policymakers to know whether a program is effective or whether it warrants a significant investment of public and/or private funds--coupled with the often-politicized debate around these topics--make it imperative for policymakers and civic leaders to have independent…

This is a workshop simulation and interpretation guide designed for Title I teachers and district personnel. The participants should have some experience with the norm-referenced evaluation model. They learn to interpret normal curve equivalents (NCE) and NCE gains. Participants are led through an interpretive hierarchy from simple, descriptive…

This guide is designed as a resource for leaders and evaluators of K-12 online learning programs. In this guide, the term "online learning" is used to refer to a range of education programs and resources in the K-12 arena, including distance learning courses offered by universities, private providers, or teachers at other schools;…

Seven methods for measuring and comparing value added in higher education are considered; six are index methods (all found unsatisfactory for lack of empirical support) and a seventh is proposed which calculates value added as the difference between the outcomes achieved and those predicted from national (United Kingdom) data. The advantages of a…

It is proposed that assessment of human translation versus machine translation programs use methods and criteria that measure efficiency and cost effectiveness and are efficient and cost-effective in themselves. A variety of methods and criteria are evaluated and discussed. (MSE)

Colleges and universities should critically review their publications periodically to save money and also as a way to present a more cohesive institutional identity. Ten recommendations are made for conducting a productive publications audit; they include choosing an evaluation method, selecting participants, making the experience pleasant, and…

The future of faculty development programs will benefit most from a systematic assessment of program goals, a factor often ignored or taken for granted while program process and product are evaluated. (MSE)

This guide, which is intended for project directors, coordinators, and other professional staff involved in developing and delivering workplace education programs, explains the workplace education evaluation process, the main approaches to evaluation, and considerations in selecting appropriate evaluation instruments. Discussed first are the…

After briefly describing the Community Experiences for Career Education project, this paper discusses 11 evaluation strategies used with the project, assesses the strengths and limitations of each, shows some relationships among them, discusses ways of communicating evaluation findings, and suggests selection criteria to others planning multiple…

Techniques used at Tufts University to evaluate its achievement and goals for institutional development efforts before beginning a new program are outlined, including identifying and assessing competition, finding measures of support volume and importance to the institution, and comparing one's own institution with others in actual and potential…

A framework is presented for developing and utilizing interinstitutional comparisons of nonacademic units in the program review process using Northeastern Illinois University of Chicago, Illinois, as an example. The framework is drawn from a review of the literature on organizational effectiveness and the various dimensions of management…