The articles in this special issue discuss efforts to improve academic reading outcomes for students and ways to achieve high implementation fidelity of promising strategies. At times the authors discuss if--and how--strong fidelity is associated with strong outcomes and potentially even impacts (the difference between program and control group…

Whether discussing the process involved in positive youth development (PYD), articulating an approach (or philosophy) of youth programs associated with PYD, or enacting a program aimed at promoting PYD, ideas derived from relational developmental systems (RDS) metatheory are pertinent. Accordingly, we discuss the RDS metamodel and explain the…

In some experimental evaluations of classroom-level interventions it is not practically feasible to randomly assign teachers to experimental conditions. Given such restrictions, researchers may randomly assign students to experimental conditions and consider the teacher to be a part of the intervention. However, in an individually randomized…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

This paper introduces a variation on the post-test only cohort control design and addresses questions concerning both the methodological credibility and the practical utility of employing this design variation in evaluations of large-scale complex professional development programmes in mathematics education. The original design and design…

This article introduces a framework designed to improve students' awareness of the need to critically evaluate websites as sources of information and to improve their skill at doing so. The framework, called the WWWDOT framework, encourages students to think about at least six dimensions when evaluating a website: (1) Who wrote this and what…

Differentiated instruction is commonly believed to be critical to improving the quality and efficiency of teachers' instructional repertoires (Fischer & Rose, 2001; Tomlinson, 2004). Tomlinson (2000) describes differentiation in four domains: content, process, product, and learning environment. Content differentiation involves varying…

Studies that examine the impacts of education interventions on key student, teacher, and school outcomes typically collect data on large samples and on many outcomes. In analyzing these data, researchers typically conduct multiple hypothesis tests to address key impact evaluation questions. Tests are conducted to assess intervention effects for…

A core component of the No Child Left Behind Act (NCLB, 2001) is the provision of free after-school tutoring services, labeled "supplemental educational services" (SES), to eligible students. Importantly, an explicit NCLB requirement makes each state responsible for evaluating individual SES providers with regard to effectiveness in…

Comments on S. Pogrow's suggestion that educational programs should be judged by the degree to which schools using them achieve "surprising scores." Emphasizes the importance of the use of control groups in program evaluation. (SLD)

Makes the case that faith in randomized controlled trials (RCTs) to determine "what works" in education may be misplaced. Identifies eight possible problems with relying on RCTs and notes that the rigor required for RCTs may not be practicable. (SLD)

This booklet contains questions and answers about random assignment in program evaluation and intervention research. The main purpose of program evaluation research in education is to determine whether programs help the students they are designed to serve and whether new ideas for education programs still under development are worthy of extension…

Explores issues in evaluating exemplary programs, including the measurement of the degree to which the program is exemplary or promising. Suggests that comparison (control) group analysis can mislead researchers about the effectiveness of a program and suggests the use of gain scores to identify exemplary programs. (SLD)

Outlines some nonrandomized constructed comparison strategies that can be used to evaluate interventions for children and illustrates their use for outcome variables that would be expected to change over age if no treatment were given. The proposed strategy consists of determining an expected age function for the dependent variable using pretest…

Describes a method that uses program participants' compliance with program instructions as a means of classifying participants and in that way obtains a randomized control group for a subset of participants. Illustrates two variations of the method through a large smoking-intervention project. (SLD)