Diverse efforts are underway to reform the journal peer review system. Combined with growing interest in Open Science practices, Open Peer Review (OPR) has become of central concern to the scholarly community. However, what OPR is understood to encompass and how effective some of its elements are in meeting the expectations of diverse communities,…

The current best evidence meta-analysis reanalyzed the data from a meta-analysis by Graham et al. (J Educ Psychol 115:1004-1027, 2023). This meta-analysis and the prior one examined if teaching writing improved the writing of students in Grades 6 to 12, examining effects from writing intervention studies employing experimental and…

Background: Traditionally, meta-analysis of time-to-event outcomes reports a single pooled hazard ratio assuming proportional hazards (PH). For health technology assessment evaluations, hazard ratios are frequently extrapolated across a lifetime horizon. However, when treatment effects vary over time, an assumption of PH is not always valid. The…

Differences in effect sizes between researcher developed (RD) and independently developed (ID) outcome measures are widely documented but poorly understood in education research. We conduct a meta-analysis using item-level outcome data to test potential mechanisms that explain differences in effects by RD or ID outcome type. Our analysis of 45…

Background: A systematic review is a secondary research method that follows a predetermined protocol to identify, synthesize, and assess the quality of primary studies that meet pre-established eligibility criteria to answer a specific research question (Higgins & Green, 2011; Higgins & Thomas, 2019). It uses systematic and transparent…

A random-effects model is often applied in meta-analysis when considerable heterogeneity among studies is observed due to the differences in patient characteristics, timeframe, treatment regimens, and other study characteristics. Since 2014, the journals "Research Synthesis Methods" and the "Annals of Internal Medicine" have…

Introduction: Concerns about the risk of bias (RoB) of Meta-analysis (MAs) have grown in parallel with the exponential increase in the number of publications in science. However, this has not been properly assessed in Education. The aims were to evaluate the RoB of MAs in Education and to identify potential predictors of a lower RoB. Methods:…

Publishing systematic review protocols is a fundamental part of systematic reviews to ensure transparency and reproducibility. In this scoping review, we aimed to evaluate reporting of Cochrane systematic review protocols with network meta-analyses (NMA). We searched all Cochrane NMA protocols published in 2018 and 2019, and assessed the…

Multiple 'overviews of reviews' conducted on the same topic ("overlapping overviews") represent a waste of research resources and can confuse clinicians making decisions amongst competing treatments. We aimed to assess the frequency and characteristics of overlapping overviews. MEDLINE, Epistemonikos and Cochrane Database of Systematic…

Meta-analysis methodology has evolved with the development of more robust statistical techniques; however, few reviews in special education have focused specifically on methodological rigor in meta-analyses. In this study, we examined 29 meta-analyses of mathematics interventions published from 2000 to 2022 to determine the extent to which…

Purpose: This article argues that the potential of the vast amount of research, published each year in the history of education, remains untapped. Given the rapidly growing number of academic publications in the field, there is a need for research that is based on articles, chapters and monographs already published. While analyses of existing…

Individual participant data meta-analyses (IPD-MAs) have several benefits over standard aggregate data meta-analyses, including the consideration of additional participants, follow-up time, and the joint consideration of study- and participant-level heterogeneity for improved diagnostic and prognostic model development and evaluation. However,…

Since the early 1990s the number of systematic reviews (SR) of animal studies has steadily increased. There is, however, little guidance on when and how to conduct a meta-analysis of human-health-related animal studies. To gain insight about the methods that are currently used we created an overview of the key characteristics of published…

Background: Systematic reviews and meta-analyses of interventions can provide critical evidence for educators and policymakers by providing insights into the effectiveness of related interventions. The quality of included studies builds the foundation for a high-quality review, while bias in the included studies increases the risks of unreliable…

In this brief report, we present a scoping review of 31 second language (L2) vocabulary research syntheses published in the Web of Science from January 1990 to May 2022. The purpose of this undertaking was to understand what L2 vocabulary research synthesizers have aggregated and the investigative foci they intended to address. It was observed…