Systematic reviews and meta-analyses aggregate research findings across studies and populations, making them a valuable form of research evidence. Over the past decade, studies in medical education using these methods have increased by 630%. However, many manuscripts are not publication-ready due to inadequate planning and insufficient analyses.…

Toward the goal of more rapid knowledge accumulation via better meta-analyses, this article explores statistical approaches intended to increase the precision and comparability of effect sizes from education research. The featured estimate of the proposed approach is a standardized mean difference effect size whose numerator is a mean difference…

Research indicating many study results do not replicate has raised questions about the credibility of science and prompted concerns about a potential reproducibility crisis. Moreover, most published research is not freely accessible, which limits the potential impact of science. Open science, which aims to make the research process more open and…

Launching biomedical innovations based on clinical demands instead of translating basic research findings to practice reduces the risk that the results will not fit the clinical routine. To realize this type of innovation, a meta-analysis of the body of research is necessary to reveal demand-matching concepts. However, both the data deluge and the…

Systematic reviewers conducting pairwise meta-analyses sometimes encounter multi-arm studies. To include these studies, and to avoid a unit-of-analysis error, often two or more arms are combined or the control arm is split. In this tutorial, we present 5 different approaches that can be used. Particularly, we present a novel approach (method 4)…

In studies with time-to-event data, outcomes may be reported as hazard ratios (HR) or binomial counts/proportions at a specific time point. If the intent is to synthesise evidence by performing a meta-analysis or network meta-analysis (NMA) using the HR as the measure of treatment effect, studies that only report binomial data cannot be included…

Current practices in study design and data analysis have led to low reproducibility and replicability of findings in fields such as psychology, medicine, biology, and economics. Because gifted education research relies on the same underlying statistical and sociological paradigms, it is likely that it too suffers from these problems. This article…

It is well documented that studies reporting statistically significant results are more likely to be published than are studies reporting nonsignificant results--a phenomenon called "publication bias". Publication bias in meta-analytic reviews should be identified and reduced when possible. Ferguson and Brannick (2012) argued that the inclusion of…

A decade ago, research on the civic engagement and learning of young people was still in a "bear market" (Cook 1985). The body of literature was strikingly small, considering that the future of democracy depends on the preparation of young citizens. Today, the situation is dramatically different. There is a torrent of research on youth civic…

In her 1970s research at Hunter College Elementary School, Gertrude Hildreth discovered that the best way to explore gifted children was by observing these children in the educational setting. Many researchers usually expound on what should be done for gifted students, yet Hildreth found that much can be learned by formally observing gifted…

Many of the methodological criticisms of the National Early Literacy Panel (NELP) report presented in this special issue of "Educational Researcher" are not specific to the NELP report but are in fact broad criticisms of much of the quantitative research on early literacy. This rejoinder demonstrates that these criticisms are off target and are…

This article summarizes "Developing Early Literacy: Report of the National Early Literacy Panel," which was published in 2008.That report provides an extensive meta-analysis of approximately 300 studies showing which early literacy measures correlate with later literacy achievement. It also provides a series of meta-analyses of a comprehensive…

Although the National Early Literacy Panel report provides an important distillation of research, the manner in which the data are reported underrepresents the importance of language. Unlike other predictors with moderate associations with later reading, language exerts pervasive and indirect influences that are not described by the effect sizes…

As part of the accountability movement, schools are increasingly called upon to provide interventions that are based on sound scientific research and that provide measurable outcomes for children. Brain Gym[R] is a popular commercial program claiming that adherence to its regimen will result in more efficient learning in an almost miraculous…

The term "publication bias" usually refers to the tendency for a greater proportion of statistically significant positive results of experiments to be published and, conversely, a greater proportion of statistically significant negative or null results not to be published. It is widely accepted in the fields of healthcare and psychological…