Auburn University engaged in the reaffirmation process with SACSCOC (institutional accreditor) and received recommendations surrounding assessment practices. It was from these recommendations that the Office of Academic Assessment (OAA) was created in July 2015, providing dedicated assessment support to faculty responsible for educational…

Statistical methods are increasingly being used to integrate findings from the ever-expanding universe of empirical research. Meta-analysis encompasses various techniques for synthesizing summary statistics, and mega-analysis pools raw data across studies. This paper offers an introduction to meta-analysis and mega-analysis that complements the…

Meta-analysis results are usually presented in forest plots, which show the individual study results and the summary effect along with their confidence intervals. In this paper, we propose a system of linear springs as a mechanical analogue of meta-analysis that enables visualization and enhances intuition. The length of a spring corresponds to a…

Traditional visualization in meta-analysis uses forest plots to illustrate the combined treatment effect, along with the respective results from primary trials. While the purpose of visualization is clear in the pairwise setting, additional treatments broaden the focus and extend the results to be illustrated in network meta-analysis. The…

This article presents reflections from 12 experts on "language learners strategy" (LLS) research. They were asked to offer their reflections in one of their domains of expertise, linking research into LLS with successful language learning and use practices. In essence, they were called upon to provide a review of recent scholarship by…

To address the evidence gap in making effective language of instruction (LOI) decisions, we propose a systematic review of the role of LOI choices in education programs and policies on literacy outcomes in multilingual educational contexts in low- and middle-income countries (LMICs). Grounded in a multidisciplinary theory of change (ToC)…

In systematic reviews, meta-analyses are routinely applied to summarize the results of the relevant studies for a specific research question. If one can assume that in all studies the same true effect is estimated, the application of a meta-analysis with common effect (commonly referred to as fixed-effect meta-analysis) is adequate. If…

The Individuals with Disabilities Education Act (2004) and the Every Student Succeeds Act (2015) both require that educators utilize instructional practices based on evidence in the literature when providing special education and related services to students with disabilities. This article provides a description of a special type of literature…

Multisite research (MSR) offers the key advantages of greater statistical power and external validity via larger and more diverse participant pools. In second language acquisition (SLA) research, recent developments in meta-analysis have created a robust foundation for MSR. Although logistical and financial obstacles can complicate expansion…

"Visible Learning Insights" presents a fascinating 'inside view' of the ground-breaking research of John Hattie. Together, the authors John Hattie and Klaus Zierer embark on a mission to build on the internationally renowned work and combine the power and authority of the research with the real 'coal face' experience of schools. Offering…

In this article I provide an overview of the methodological issues involved in measuring constructs relevant to character development and education. I begin with a nontechnical overview of the 3 fundamental psychometric properties of measurement: reliability, validity, and equivalence. Developing and evaluating measures to ensure evidence of all 3…

This document summarises key findings from the quantitative strands of a review of the Education Endowment Foundation (EEF) evaluations that had reported from the establishment of EEF in 2011 up to January 2019. The quantitative strands summarised include meta-analyses of effect sizes reported for attainment outcomes and descriptive analyses of…

Much of the evidential basis for recent policy decisions is grounded in effect size: the standardised mean difference in outcome scores between a study's intervention and comparison groups. This is interpreted as measuring educational influence, importance or effectiveness of the intervention. This article shows this is a category error at two…

Moment-based estimators of the between-study variance are very popular when performing random effects meta-analyses. This type of estimation has many advantages including computational and conceptual simplicity. Furthermore, by using these estimators in large samples, valid meta-analyses can be performed without the assumption that the treatment…

A recent meta-analysis of the effect of financial literacy and financial education on downstream financial behaviors has shown a weak collective impact of the work of financial education. While the findings are not stellar, they do not support a dismantling of financial education programs and funding. This paper examines the findings of the…