Overviews, or syntheses of research syntheses, have become a popular approach to synthesizing the rapidly expanding body of research and systematic reviews. Despite their popularity, few guidelines exist and the state of the field in education is unclear. The purpose of this study is to describe the prevalence and current state of overviews of…

Quantitative mixed models were used to examine literature published from 1966 through 2016 on the effectiveness of Direct Instruction. Analyses were based on 328 studies involving 413 study designs and almost 4,000 effects. Results are reported for the total set and subareas regarding reading, math, language, spelling, and multiple or other…

This review describes a meta-analysis of findings from 50 controlled evaluations of intelligent computer tutoring systems. The median effect of intelligent tutoring in the 50 evaluations was to raise test scores 0.66 standard deviations over conventional levels, or from the 50th to the 75th percentile. However, the amount of improvement found in…

In education research, small samples are common because of financial limitations, logistical challenges, or exploratory studies. With small samples, statistical principles on which researchers rely do not hold, leading to trust issues with model estimates and possible replication issues when scaling up. Researchers are generally aware of such…

Educational researchers and practitioners assert that supportive school and classroom climates can positively influence the academic outcomes of students, thus potentially reducing academic achievement gaps between students and schools of different socioeconomic status (SES) backgrounds. Nonetheless, scientific evidence establishing directional…

Previous research has shown that treating dependent effect sizes as independent inflates the variance of the mean effect size and introduces bias by giving studies with more effect sizes more weight in the meta-analysis. This article summarizes the different approaches to handling dependence that have been advocated by methodologists, some of…

The dominant literature on research synthesis methods has positivist and neo-positivist origins. In recent years, the landscape of research synthesis methods has changed rapidly to become inclusive. This article highlights methodologically inclusive advancements in research synthesis methods. Attention is drawn to insights from interpretive,…

A dozen schemes proposing to classify research questions are surveyed, analyzed, and applied to the understanding and practice of inquiry. The extent to which these schemes account for questions found in educational journals is estimated. Principles and issues are identified to stimulate work on the classification of research questions. (Author/BS)

Issues of reliability and validity in ethnographic design are compared to their counterparts in experimental design. Threats to the credibility of ethnographic research are summarized and categorized. Strategies intended to enhance credibility (study design, data collection, data analysis, and presentation of findings) are incorporated throughout…

R. T. Ogawa and B. Malen's article does not meet its own recommended standards for rigorous testing and presentation of its own conclusions. Use of the exploratory case study to analyze multivocal literatures is not supported, and the claim of grounded theory to analyze multivocal literatures may be stronger. (SLD)

The major theme is that better and more productive studies could emerge if media research would move out of its traditional either-internal- or-external validity conflict. (Author/MV)

Research design sampling models regarding educational research of within-grade influences on overall educational experiences are discussed and limitations of each model noted. (DEP)

This meta-analysis summarizes teaching effectiveness studies of the past decade and investigates the role of theory and research design in disentangling results. Compared to past analyses based on the process-product model, a framework based on cognitive models of teaching and learning proved useful in analyzing studies and accounting for…

Differences between ethnographic, phenomenological, or qualitative research techniques are reviewed through an explanation of the rationale behind their use and discussion of some of the processes by which this type of research is conducted. While this article is focused on educational research, the discussion applies equally to social…

An examination of the weaknesses of the common statistical approaches suggests that change scores are unnecessary and often even inappropriate for statistical studies. Alternative statistical procedures are suggested. (Author/VW)