In this article, the authors address some of the scientific challenges associated with using observation as a research method. The authors ask how researchers contextualise and understand observation in terms of its theoretical underpinnings and how it is conducted. Using a vignette in the kindergarten context, the authors explore how observation…

Children's fuzziness leads to increased variance in the data, data loss, and high dropout rates in developmental studies. This study investigated the importance of 20 factors on the person (child, caregiver, experimenter) and situation (task, method, time, and date) level for the data quality as indicated via the number of valid trials in 11…

In this article, we reflect on our experiences with teaching ethnographic skills and sensibilities to MSc students at a Dutch university. Using methods such as (self)observation, journaling and reflection, we highlight dilemmas (conceptual, practical, ethical) faced by students when doing ethnographic fieldwork and dilemmas that emerged in…

Pre-registration refers to the practice of researchers preparing a time-stamped document describing the plans for a study. This open research tool is used to improve transparency, so that readers can evaluate the extent to which the researcher adhered to their original plans and tested their theory appropriately. In the current study, we conducted…

Large language models (LLMs), through their exposure to massive collections of online text, learn to reproduce the perspectives and linguistic styles of diverse social and cultural groups. This capability suggests a powerful social scientific application--the simulation of empirically realistic, culturally situated human subjects. Synthesizing…

The evidence for a reproducibility crisis in the sciences is overwhelming. Nevertheless, this crisis has not received sufficient attention in kinesiology. This must be remedied for kinesiology research is as vulnerable to the problems of the reproducibility crisis as any other discipline. The causes of this crisis include human, statistical and…

This paper investigates the methodological discrepancies underlying the measurement of adult learning and education (ALE) participation in the UK by focusing on four major surveys -- APiL, PIAAC, AES, and LFS. Grounded in the Total Survey Error (TSE) framework, we systematically examined the surveys' documentation and compared their definitions,…

The aim of this article is to call for qualitative researchers in education and other human sciences to grapple with recent developments in trauma studies and engage in reconceptualizing their research practices so that they pay attention to the catastrophic effects of colonialism on individuals and communities. Joining other critics who have…

Discrete-time survival analysis (DTSA) models are a popular way of modeling events in the social sciences. However, the analysis of discrete-time survival data is challenged by missing data in one or more covariates. Negative consequences of missing covariate data include efficiency losses and possible bias. A popular approach to circumventing…

In sparse data meta-analyses (with few trials or zero events), conventional methods may distort results. Although better-performing one-stage methods have become available in recent years, their implementation remains limited in practice. This study examines the impact of using conventional methods compared to one-stage models by re-analysing…

Despite their many benefits, longitudinal studies are much less common than one-time data collection or pre-post intervention designs. One reason for their scarcity is that longitudinal studies introduce requirements and challenges that non-longitudinal studies do not. One of the biggest challenges is participant attrition. In order to help…

Purpose: This paper contends that data generated by research on supervision are often taken as authentic data. Through an examination of studies that use audio/visual recordings to investigate supervision, the paper both promotes and problematises the recording of supervision meetings as a useful technique for doctoral supervision research. This…

Previous research extensively studied reasons for and ways to avoid low response rates, but it largely ignored the primary research issue of the degree to which response rates matter, which we address. Methodological survey research on response rates has been concerned with how to increase responsiveness and with the effects of response rates on…

Purpose: The lack of a definite standard for determining the sample size in qualitative research leaves the research process to the initiative of the researcher, and this situation overshadows the scientificity of the research. The primary purpose of this research is to propose a model by questioning the problem of determining the sample size,…

Introduction: Concerns about the risk of bias (RoB) of Meta-analysis (MAs) have grown in parallel with the exponential increase in the number of publications in science. However, this has not been properly assessed in Education. The aims were to evaluate the RoB of MAs in Education and to identify potential predictors of a lower RoB. Methods:…