This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

In an effort to bring rigorous research into the education and social sciences field, the past decade had seen an increase in the advocacy of randomized controlled trials. The argument in favor of using randomized controlled trial is that one can evaluate the impact of an intervention in comparison to a control group with confidence during a…

Commentaries regarding appropriate methods for researching professional development have been a frequent topic in recent issues of "Educational Researcher" as well as other venues. In this article, the authors extend this discussion by observing that randomized trials of specific professional development programs have not enhanced our…

Background: In elementary grades, comprehensive health education curricula have demonstrated effectiveness in addressing singular health issues. The Michigan Model for Health (MMH) was implemented and evaluated to determine its impact on nutrition, physical fitness, and safety knowledge and skills. Methods: Schools (N = 52) were randomly assigned…

The concept of "implementation fidelity" is broadly used to capture the extent to which an intervention is executed as intended by the designers of the intervention (Century, Rudnick, & Freeman, 2010; Huntley, 2005, McNaught, Tarr, & Sears, 2010, Munter, 2010). Though implementation fidelity instruments are often used to assess…

For RCTs of education interventions, it is often of interest to estimate associations between student and mediating teacher practice outcomes, to examine the extent to which the study's conceptual model is supported by the data, and to identify specific mediators that are most associated with student learning. This article develops statistical…

This three-volume report describes the "SAM (School Administration Manager) process," an approach that about 700 schools around the nation are using to direct more of principals' time and effort to improve teaching and learning in classrooms. Research has shown that a principal's instructional leadership is second only to teaching among…

This guide is designed as a resource for leaders and evaluators of K-12 online learning programs. In this guide, the term "online learning" is used to refer to a range of education programs and resources in the K-12 arena, including distance learning courses offered by universities, private providers, or teachers at other schools;…

The paper discusses two common scenarios in which evaluators must conduct impact evaluations when working under budget, time, or data constraints. Under the first scenario the evaluator is not called in until the project is already well advanced, and there is a tight deadline for completing the evaluation, frequently combined with a limited budget…

The difficulties in evaluating bilingual education appear to have prevented success in all but a few evaluation attempts, but better and more meaningful evaluation is neccessary in order to identify the strengths and weaknesses of bilingual programs. Many bilingual programs are undergoing constant modification, adequate assessment instruments have…

A context in which existing items may provide a convenient source of questions for questionnaires was explored through a case study making use of existing comparison groups. Two programs at Oak Ridge Associated Universities (ORAU), the Science and Engineering Research Semester (SERS) and the Laboratory Graduate Research Participation (Lab Grad)…

Recruiting schools and kids to participate in drug prevention evaluations is no longer, if it ever was, a "done deal." Since the mid-1980s, schools have been inundated with requirements for drug programs and requests to cooperate with program evaluations. As a consequence, both treatment and control schools are harder to find. In addition, many…

A program of functional literacy, as an integral part of the program of Farmers' Training and Functional Literacy, is presented. Its objectives are: (1) to increase the attainment and use of literacy skills, and (2) to bring about the socio-economic change on the individual with particular emphasis on changes in agricultural production. The…

The original version of this report dealt with the feasibility of a longitudinal design for studying the effects of preceptorships on medical students' career choices. The present document supplements the original report, focuses on various non-longitudinal designs, and assesses their suitability for providing the type of information required for…

The orientation of this report is that of identifying educational projects which can be considered clearly exemplary. The largest section consists of a 22-step procedure for validating the effectiveness of educational projects using existing evaluation data. It is not intended as a guide for conducting evaluations but rather for interpreting data…