More aggregate data on school performance is available than ever before, opening up new possibilities for applied researchers interested in assessing the effectiveness of school-level interventions quickly and at a relatively low cost by implementing comparative interrupted times series (CITS) designs. We examine the extent to which effect…

This study examined a five-year project initiated by the Women's Global Connection (WGC) to train pre-primary teachers in schools serving HIV/AIDS orphans in Zambia. The researchers evaluated the contextual factors of the training initiative to clarify why some teachers possess high self-efficacy, while others do not. The article analyses the…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

This three-volume report describes the "SAM (School Administration Manager) process," an approach that about 700 schools around the nation are using to direct more of principals' time and effort to improve teaching and learning in classrooms. Research has shown that a principal's instructional leadership is second only to teaching among…

In this set of four supplemental tables, the authors compare the baseline test scores of the treatment and matched control group samples observed in each year after KIPP entry (outcome years 1 to 4). As discussed in Chapter III, the authors used an iterative propensity score estimation procedure to calculate each student's probability of entering…

Methods useful in identifying and assessing outcomes of relatively simple programs may not be practical or appropriate for complex programs and systems. Comparative case study methods are recommended for dealing with such global outcomes of planned organizational change. (Author)

The notion of comparing in curriculum evaluation is discussed, and some approaches to making comparative judgments about program effectiveness during the formative and summative evaluation stages are examined. Sources of information provided by external and internal program comparisons are described, and a model in which a policy capturing…

The Voluntary Public School Choice (VPSC) Program supports the emergence and growth of choice initiatives across the country, by assisting states and local school districts in developing innovative strategies to expand public school choice options for students. This report contains the final assessment of the first five years of the VPSC Program…

Evaluation of large-scale programs is problematical because of inherent bias in assignment of treatment and control groups, resulting in serious regression artifacts even with the use of analysis of covariance designs. Nonuniformity of program implementation across sites and classrooms is also a problem. (Author/GSK)

This monograph critiques the many nonexperimental impact estimation approaches that have been based on external comparison groups. It proposes an approach to evaluating employment and training (E&T) programs that calls for using the group of individuals who apply to a program but then choose not to participate in that program as an…

The Research Triangle conducted an evaluation study of the Upward Bound Program, a nationwide program funded by the U.S. Office of Education to help selected low-income high school students prepare for and enter post secondary education. This paper describes the sample design and selection procedures used in selecting a sample of Upward Bound…

Suggestions, based on the experience of researchers at Oak Ridge (Tennessee) Associated Universities (ORAU), are offered on how evaluations in which true experimental designs are not possible can be designed for meaningful comparison. The ORAU conducts evaluation and assessment studies of educational programs intended to explore some aspect of the…

A study investigated the usefulness of a new ambulatory medicine clerkship design by randomly assigning students to it or to an existing traditional general medicine rotation, then comparing student performance on the licensing examination, a laboratory interpretation test, written work, and a problem-solving exam. Performances were the same…

This interim report of a pilot year impact study on evaluation methodology is part of a series of documents on the evaluation of Project Developmental Continuity, a Head Start demonstration program aimed at promoting educational and developmental continuity between children's Head Start and primary school experiences. This report deals with…

A study explored which nonexperimental comparison group methods provide the most accurate estimates of the impacts of mandatory welfare-to-work programs and whether the best methods work well enough to substitute for random assignment experiments. Findings were compared for nonexperimental comparison groups and statistical adjustment procedures…