Purpose: This paper engages Olaf Zawacki-Richter and Insung Jung in a frank and penetrating conversation that seeks to ground, frame, and problematise research in the field conceptualised as "open, distance and digital education" (ODDE). Taking as starting point the recent publication of the landmark "Handbook of Open, Distance, and…

Introduction: The What Works Clearinghouse (WWC) reviews rigorous research on educational interventions with a goal of identifying "what works" and making that information accessible to educators and policymakers. In rating the quality of causal research, the WWC has historically prioritized internal validity over external validity. One…

Purpose: This paper contends that data generated by research on supervision are often taken as authentic data. Through an examination of studies that use audio/visual recordings to investigate supervision, the paper both promotes and problematises the recording of supervision meetings as a useful technique for doctoral supervision research. This…

School leadership research literature has a large number of widely used constructs. Could fewer constructs bring more clarity? This study evaluates construct content validity, defined as the extent to which a measure's items reflect a theoretical content domain, in school leadership literature. To do so, we reviewed 29 articles that used Teaching…

This paper explores the challenges of filming as a qualitative research method in practical school subjects. We exemplify with an observation study using video data collected from lessons in Home Economics, but the issues we discuss are also relevant for other subjects with practical elements, such as Arts, Crafts, Music, Physical Education, and…

This study examines potential assessment bias based on students' primary language status in PISA 2018. Specifically, multilingual (MLs) and nonmultilingual (non-MLs) students in the United States are compared with regard to their response time as well as scored responses across three cognitive domains (reading, mathematics, and science).…

Previous research extensively studied reasons for and ways to avoid low response rates, but it largely ignored the primary research issue of the degree to which response rates matter, which we address. Methodological survey research on response rates has been concerned with how to increase responsiveness and with the effects of response rates on…

We provide a novel characterization of augmented balancing weights, also known as automatic debiased machine learning (AutoDML). These popular "doubly robust" or "de-biased machine learning estimators" combine outcome modeling with balancing weights -- weights that achieve covariate balance directly in lieu of estimating and…

Purpose: The lack of a definite standard for determining the sample size in qualitative research leaves the research process to the initiative of the researcher, and this situation overshadows the scientificity of the research. The primary purpose of this research is to propose a model by questioning the problem of determining the sample size,…

Introduction: Concerns about the risk of bias (RoB) of Meta-analysis (MAs) have grown in parallel with the exponential increase in the number of publications in science. However, this has not been properly assessed in Education. The aims were to evaluate the RoB of MAs in Education and to identify potential predictors of a lower RoB. Methods:…

As traditionally conceived, publication bias arises from selection operating on a collection of individually unbiased estimates. A canonical form of such selection across studies (SAS) is the preferential publication of affirmative studies (i.e., those with significant, positive estimates) versus nonaffirmative studies (i.e., those with…

We conducted a multi-pronged investigation of different types of reporting bias in autism early childhood intervention research. First, we investigated the prevalence of reporting failures of completed trials registered on clinicaltrials.gov, and found that only 7% of registered trials were updated with results on the registration platform and…

Mixed research is a methodology of growing importance both within and without education. This type of research forces researchers to reconcile conflicting ways of justifying and understanding research with results that have the potential to be forward pointing for all researchers. As mixed research has grown, mixed research has gained an…

Numerous articles and textbooks advise qualitative researchers on accessing "hard-to-reach" or "hidden" populations. In this article, I compare two studies that I conducted with justice-involved women in the United States: a yearlong ethnography inside a state women's prison and an interview study with formerly incarcerated…

Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms…