In the "individually randomized group treatment" (IRGT) experimental design, individuals are first randomly assigned to a treatment arm or a control arm, but then within each arm, are grouped together (e.g., within classrooms/schools, through shared case managers, in group therapy sessions, through shared doctors, etc.) to receive…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

This three-volume report describes the "SAM (School Administration Manager) process," an approach that about 700 schools around the nation are using to direct more of principals' time and effort to improve teaching and learning in classrooms. Research has shown that a principal's instructional leadership is second only to teaching among…

The authors' purpose was to explore the effects of a supplementary, guided, silent reading intervention with 80 struggling third-grade readers who were retained at grade level as a result of poor performance on the reading portion of a criterion referenced state assessment. The students were distributed in 11 elementary schools in a large, urban…

It is widely known that there is a dearth of education research in South Africa which takes as its methodological basis experimentation. The emphasis has been on educators' and learners' experiential understanding in the first decade of democracy after apartheid, when qualitative research predominated. The article investigates, first, the extent…

Background: A literature search found five empirical studies of psychological treatment for adults with ADHD, out of 1,419 articles on ADHD in adults. Practice guidelines to date all recommend multimodal intervention, given that a significant number of patients cannot tolerate, do not respond to, or fail to reach optimal outcomes with medication…

Randomized controlled trials in educational research tend to be small. Small trials can have large, chance, imbalances in important covariates. For studies with sample sizes greater than 50, chance imbalances can be corrected using analysis of covariance; for small trials, however, statistical power is maximized if the trial is balanced and…

Parametric analysis of covariance was compared to analysis of covariance with data transformed using ranks. Using a computer simulation approach the two strategies were compared in terms of the proportion of Type I errors made and statistical power when the conditional distribution of errors were: (1) normal and homoscedastic, (2) normal and…

Expresses the importance of scientifically based research in education reform and explains how to judge the validity of educational research. Describes control groups, randomized and matched experiments, statistical educational significance, sample size, and the difference between scientifically based and rigorously evaluated research. (Contains…

This report summarizes the National Job Training Partnership Act (JTPA) Study, which examined the impact of Title IIA of JTPA on participants' employment, earnings, and welfare receipt. Between 1987 and 1989, more than 20,000 adults and out-of-school youths who applied for JTPA services in 16 areas across the country were randomly assigned to a…

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…

Research efforts have established that the Mantel-Haenszel procedure (MHP) is an effective method for detecting the presence of test items exhibiting differential item functioning (DIF). While the MHP has been advocated for situations where item response theory based methods may not be usable, recent findings have suggested that the performance of…

The National Job Corps Study was conducted in 1994-1996 to provide a thorough and rigorous assessment of the impacts of the Job Corps on key participant outcomes. To ensure that the study was well implemented, a study team from Mathematica Policy Research, Inc., (MPR) investigated outcome and admission (OA) procedures in each Job Corps region and…