Over the past 15 years, we have seen an increase in the use of cluster randomized trials (CRTs) to test the efficacy of educational interventions. These studies are often designed with the goal of determining whether a program works, or answering the what works question. Recently, the goals of these studies expanded to include for whom and under…

Background: The use of randomised controlled trials (RCTs) in education has increased significantly over the last 15 years. However, their use has also been subject to sustained and rather trenchant criticism from significant sections of the education research community. Key criticisms have included the claims that: it is not possible to undertake…

Card and Giuliano conducted a regression discontinuity study in a large Florida school district to investigate the magnitude of academic benefits of the district's gifted program. They found that for children identified as gifted through an intelligence test, the program provided few or no benefits. But children who were admitted to the gifted…

This report examines the range of factors that might influence the decision by social care professionals on the use of boarding schools as an intervention option for Children in Need (CiN) or children on a Child Protection Plan (CPP). Attempts to conduct a randomised controlled trial (RCT) failed to recruit participants. Initially, failure to…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

Upward Bound (UB) was one of the original federal "Great Society" programs of the 1960s and remains, fifty years later, the single largest college access program in the country. Recently, Congress has reduced funding and considered eliminating the program because of federal budget pressures and because the first analysis of the only…

This paper reviews literature on the rationale, challenges, and recommendations for choosing a nonequivalent comparison (NEC) group design when evaluating intervention effects. After reviewing frequently addressed threats to validity, the paper describes recommendations for strengthening the research design and how the recommendations were…

In order to better assist practitioners and better serve persons with autism spectrum disorders (ASD) and their families, it is vital for professionals to systematically evaluate the existing body of literature and synthesize its scientific evidence, so that the efficacy of research can be translated to evidence-based practices (EBPs) (Wheeler,…

The science-to-service problem continues to taunt the field of education (Fixsen, Blasé, Naoom, & Wallace, 2009). As an academic discipline, the field requires knowledge generation that adds to or deepens theoretical understandings. As a profession, knowledge generation that solves local problems and supports continuous improvement is…

Background/Context: School finance litigation has often prompted funding reforms, but what happens as a result is the subject of considerable dispute. Purpose: This article explores design problems encountered in studies examining the nature and effects of those reforms. Analysis: After describing the development and current status of school…

This review examines 105 empirical studies that investigate students' views of the nature of science (VNOS), effects of curricular interventions on changing students' VNOS, and relations between VNOS and demographics, majors, and learning of science. The reviewed studies can be categorized into three theoretical frameworks: the unidimension, the…

This article discusses the use of propensity scoring in experimental program evaluations to estimate impacts for subgroups defined by program features and participants' program experiences. The authors discuss estimation issues and provide specification tests. They also discuss the use of an overlooked data collection design--obtaining predictions…

Presented as part of a symposium on evaluation on juvenile diversion programs, this brief paper describes several specific research procedures which have been utilized to help decide which type of diversion approach is best for specific types of clients. Procedures discussed are the regression discontinuity design, the tie-breaker design, and the…

Shows how evaluation design and federal involvement in Youth Employment Demonstration Projects unintentionally cause a negative appraisal. Indicates the problem stems from interaction of the contract research corporation, the educational research establishment, and the federal bureaucracy, rather than a specific methodology or bureaucratic…

This is a response to the criticism of "Sesame Street" by Herbert A. Sprigle in the December, 1972, issue of "Childhood Education." It is maintained that Sprigle misconstrued and misrepresented the program's mandate and objectives and that the design and reporting of his study are so flawed that his conclusions are virtually…