Background: COVID-19 accentuated an evergreen dilemma in evidence-informed policy making--the imperative to synthesise the best available evidence with limited time to produce high quality synthesis. The pandemic prompted the adaptation of evidence synthesis practices to match the urgency of the crisis, and heightened demand by policy makers,…

A recent issue of the Australian Journal of Language and Literacy included an article reporting on a systematic narrative review of the research literature that indicated that there was insufficient evidence to conclude whether genre theory and systemic functional linguistics either 'worked' or 'did not work'. The criteria used to evaluate these…

The realist review/synthesis has become an increasingly prominent methodological approach to evidence synthesis that can inform policy and practice. While there are publication standards and guidelines for the conduct of realist reviews, published reviews often provide minimal detail regarding how they have conducted some methodological steps.…

Using reading research as an example, this article aims to provide new conceptual tools for examining the production of scientific knowledge. Drawing on the metaphor of a theatre of truth, it explores how scientific knowledge is staged, dramatised and communicated within the field of reading research. It highlights the performative and public…

Predatory journals are a blemish on scholarly publishing and academia and the studies published within them are more likely to contain data that is false. The inclusion of studies from predatory journals in evidence syntheses is potentially problematic due to this propensity for false data to be included. To date, there has been little exploration…

This scoping review aims to identify and systematically review published mapping reviews to assess their commonality and heterogeneity and determine whether additional efforts should be made to standardise methodology and reporting. The following databases were searched; Ovid MEDLINE, Embase, CINAHL, PsycINFO, Campbell collaboration database,…

An overview of reviews aims to collect, assess, and synthesize evidence from multiple systematic reviews (SRs) on a specific topic using rigorous and reproducible methods. An important methodological challenge in conducting an overview of reviews is the management of overlapping data due to the inclusion of the same primary studies in SRs. We…

Background: There is a plethora of reviews that summarize much of the evidence base in Social and Emotional Learning (SEL). However, there are criticisms around variability of quality and focus of those reviews, meaning there is little strategic overview of the current state of the field. Further, there are rising concerns as to systemic gaps in…

In 2020, the What Works Clearinghouse (WWC) for single-case experimental design (SCED) studies released an updated version of their standards and procedures handbook (Version 4.1). Because of these updates, there is a need to understand the implications for the field in terms of quality rating of the design, and subsequent synthesis of evidence at…

Evidence syntheses that engage librarians as co-authors produce higher-quality results than those that do not. Trained as teachers, researchers, and information managers, librarians possess expert knowledge on research methodologies and information retrieval approaches that are critical for evidence synthesis. Researchers are under increasing…

Through the process of compiling and analyzing data for our recent Council for the Accreditation of Education Preparation (CAEP) accreditation review and ultimate self-study report, we engaged in a collaborative action research project. Presented through the lens of a case study, we identify various reasons researchers may opt for such an…

The aim of the present work was to identify published methodological guidance for rapid reviews (RRs) and to analyze the recommendations with regard to time-saving measures. A literature search was performed in PubMed and EMBASE in November 2020. In addition, a search based on Google Scholar and websites of governmental and non-governmental…

The tradition of qualitative research drives much of chemistry education research activity. When performing qualitative studies, researchers must demonstrate the trustworthiness of their analysis so researchers and practitioners consuming their work can understand if and how the presented research claims and conclusions might be transferable to…

Educational researchers have concluded that there are threshold concepts in a large number of disciplines. Yet, these researchers have not paid enough attention to the objection to the theory. It is beset with severe definitional and empirical problems. I will portray definitions of 'threshold concepts' provided by Land and Meyer, the founding…

Systematic reviews of single-case experimental research (SCER) in special education often use the What Works Clearinghouse (WWC) Standards to assess the methodological rigor of studies within a given literature base. While significant changes were made between the two most recent versions of the WWC standards, no research to date has evaluated the…