Introduction: The replication crisis in the behavioral and social sciences spawned a credibility revolution, calling for new open science research practices that ensure greater transparency, including preregistrations, open data and code, and open access. Statement of the Problem: Replications of published research are an important element in this…

This systematic review examines the empirical research conducted in the past decade to investigate the application of immersive Virtual Reality (IVR) in geography higher education. Our analysis includes 29 empirical studies published across 25 peer-reviewed articles and delves into IVR applications from four key perspectives: the temporal and…

Prior research has suggested that clustered regression discontinuity designs are a formidable alternative to cluster randomized designs because they provide targeted treatment assignment while maintaining a high-quality basis for inferences on local treatment effects. However, methods for the design and analysis of clustered regression…

This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

Large language models (LLMs) provide cost-effective but possibly inaccurate predictions of human behavior. Despite growing evidence that predicted and observed behavior are often not "interchangeable," there is limited guidance on using LLMs to obtain valid estimates of causal effects and other parameters. We argue that LLM predictions…

Cluster-randomized trials have been widely used to evaluate the treatment effects of interventions on student outcomes. When interventions are implemented by teachers, researchers need to account for the nested structure in schools (i.e., students are nested within teachers nested within schools). Schools usually have a very limited number of…

Random encouragement designs evaluate treatments that aim to increase participation in a program or activity. These randomized controlled trials (RCTs) can also assess the mediated effects of participation itself on longer term outcomes using a complier average causal effect (CACE) estimation framework. This article considers power analysis…

Processes that unfold over individuals' life courses are often associated with inequalities later in life. The literature lacks methodological approaches to analyze inequalities in outcomes between groups, for example, between women and men, in a life-course-sensitive manner. We propose a combination of methods--of sequence analysis, which enables…

This study investigated the role of ChatGPT-assisted data analysis in mathematics education research within the post-modern scholarly milieu using a scoping review approach. This examined how ChatGPT contributes to ethical, reliable, rigorous, and context-sensitive data analysis in mathematics education research. The findings reveal five (5)…

Introduction: The current economic, social and environmental problems faced by society are some of the most emerging concerns of the main governmental institutions. In this sense, Education for Sustainable Development and integration of the Sustainable Development Goals (SDGs) into the education system seems to be a key link for its mitigation.…

The purpose of this paper is to elaborate and comment on some themes related to construct validity, construct choice, and construct respecification in the Campbellian validity system. It is argued that Reichardt's [(2008, November). An alternative to the Campbellian conceptualization of validity. (Paper presentation). Evaluation 2008 Conference,…

The global push to reorient social sciences in an increasingly technical direction might have a clear labour-market justification, but the efforts face headwinds from both faculty and students. This research is concerned with the fear that students would resist such a reorientation. Much of the pedagogic social-science research seeks ways to…

Purpose: This scoping review aims to investigate the current utilization of a QuantCrit approach within educational research. Design/methodology/approach: The research follows the methodological framework proposed by Arksey and O'Malley (2005), employing comprehensive search criteria across various databases to select 24 relevant studies for…

School start regulations allocate children born immediately either side of a given date to different life paths: those slightly older starting school a full year earlier. School effectiveness literature exploits this to estimate causal effects described as 'the absolute effect of schooling' or 'the effect of an additional year's schooling', using…

This article presents methods for using extant data to improve the properties of estimators of the standardized mean difference (SMD) effect size. Because samples recruited into education research studies are often more homogeneous than the populations of policy interest, the variation in educational outcomes can be smaller in these samples than…