Many teacher education researchers have expressed concerns about the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, measurement, and external validity. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

This review describes a meta-analysis of findings from 50 controlled evaluations of intelligent computer tutoring systems. The median effect of intelligent tutoring in the 50 evaluations was to raise test scores 0.66 standard deviations over conventional levels, or from the 50th to the 75th percentile. However, the amount of improvement found in…

This meta-analysis provides an extensive and organized summary of intervention studies in education that are grounded in motivation theory. We identified 74 published and unpublished papers that experimentally manipulated an independent variable and measured an authentic educational outcome within an ecologically valid educational context. Our…

We review the effectiveness of first-year seminars based on the widely used criteria of first-year grades and the 1-year retention rate. Meta-analytic results indicate that first-year seminars have a small average effect on both first-year grades (k = 89, N = 52,406, d = 0.02) and the 1-year retention rate (k = 195, N = 169,666, d = 0.11). We…

Professional development programs are based on different theories of how students learn and different theories of how teachers learn. Reviewers often sort programs according to design features such as program duration, intensity, or the use of specific techniques such as coaches or online lessons, but these categories do not illuminate the…

The major theme is that better and more productive studies could emerge if media research would move out of its traditional either-internal- or-external validity conflict. (Author/MV)

This article analyzes 41 studies that evaluated K-12 parent involvement programs in order to assess claims that such programs are an effective means of improving student learning. It examines the characteristics of the parent involvement programs, as well as the research design, data, and analytical techniques used in program evaluation. Our…

Meta analysis results were compared with a traditional review of bilingual education program effectiveness. When controlled for methodological inadequacies, participation in bilingual education programs consistently produced differences favoring bilingual education. The methodological inadequacies in the synthesized studies highlights the need for…