This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

Recruitment is a key challenge for researchers conducting any large school-based study. Control is needed not only over the condition participants receive, but also over how the intervention is implemented, and may include restrictions in other areas of school and classroom functioning. We report here on our experiences in recruiting participants…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

It is widely known that there is a dearth of education research in South Africa which takes as its methodological basis experimentation. The emphasis has been on educators' and learners' experiential understanding in the first decade of democracy after apartheid, when qualitative research predominated. The article investigates, first, the extent…

This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools--which comprise three levels of clustering (students in classrooms in schools)--to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises…

Randomized controlled trials in educational research tend to be small. Small trials can have large, chance, imbalances in important covariates. For studies with sample sizes greater than 50, chance imbalances can be corrected using analysis of covariance; for small trials, however, statistical power is maximized if the trial is balanced and…

Using meta-analysis, randomized experiments in education that either clearly did or clearly did not experience student attrition were examined for the baseline comparability of groups. Results from 35 studies suggested that after attrition, the observed measures of baseline comparability of groups did not differ more than would be expected given…

Explains the characteristics and importance of random assignment in experimental research on education. Considers factors supporting causal inferences, the nature of "assignment units," differences between random sampling and random assignment, the characteristics of randomization tests, forms of random assignment, and effects of experimental…

Research articles published in 10 major journals during the years 1984-1987 were evaluated to determine how many satisfied the recommendations of the Council for Learning Disabilities' Research Committee on reporting subject data. Only 4 of the 277 articles included acceptable information in 7 recommended areas of subject data. (Author/JDD)

A review and meta-analysis were made of placebo control groups in educational experiments. In all, 125 studies were clustered into procedures that included (1) explicit manipulation of attentional elements; (2) explicit description of the placebo activity plus implied reference to attention; and (3) exclusive reference to the activity. (SLD)

A meta-analysis was conducted on 44 educational studies that used either a (labelled) Hawthorne control group, a manipulation of Hawthorne effects, or a group designed to control for the Hawthorne effect. The sample included published journal articles, ERIC documents or unpublished papers, and dissertations. The studies were coded on 20 variables,…

A review of 208 studies of children with learning disabilities (LD) published in 10 major journals between 1988 and 1990 examined the extent to which recommendations concerning research design and reporting made in 1980 and 1984 have been implemented. The review found continuing problems, including imprecise subject descriptions, heterogeneous…

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…

While inquiry teaching has been a popular term in the social studies literature over the last decade, the empirical research appears to have paid little attention to specific inquiry models. All published papers and dissertations purporting to measure inquiry teaching for the five year period, January, 1967 through November, 1972 are reviewed and…