The reproducibility crisis in the sciences is now well established. Curiously, only sporadic attention has been paid to it in kinesiology. This is a mistake. The scientific research produced in kinesiology is not exempt from the causes of the crisis. These causes include human, statistical and philosophical limitations inherent to the scientific…

Missing data are common with large scale assessments (LSAs). A typical approach to handling missing data with LSAs is the use of listwise deletion, despite decades of research showing that approach can be a suboptimal strategy resulting in biased estimates. In order to help researchers account for missing data, we provide a tutorial using R and…

Purpose: The primary objective of this research paper was to examine the objectivity of the preselected items evaluation (PIE) method, a prevalent translation scoring method deployed by international institutions such as UAntwerpen, UGent and the University of Granada. Design/methodology/approach: This research critically analyzed the scientific…

Research has paid less attention to the formalization of education from a systems theory and control perspective, rather than a mere algorithmic one. In this work, the underpinnings of system theory and control are provided, along with a review of their application in education. The review of studies in databases found only seven articles that…

Distances derived from word embeddings can measure a range of gradational relations--similarity, hierarchy, entailment, and stereotype--and can be used at the document- and author-level in ways that overcome some of the limitations of weighted dictionary methods. We provide a comprehensive introduction to using word embeddings for relation…

The growing popularity of generative artificial intelligence (AI) tools presents new challenges for data quality in online surveys and experiments. This study examines participants' use of large language models to answer open-ended survey questions and describes empirical tendencies in human versus large language model (LLM)-generated text…

Children's fuzziness leads to increased variance in the data, data loss, and high dropout rates in developmental studies. This study investigated the importance of 20 factors on the person (child, caregiver, experimenter) and situation (task, method, time, and date) level for the data quality as indicated via the number of valid trials in 11…

In the early months of the COVID-19 pandemic, many research funding organizations were faced with the choice of suspending their peer review panels, or else continuing their decision-making processes virtually. Although seen part of a longer drive to make peer review more cost and time efficient as well as to combat climate and sustainability…

Narratives that dominant the discourse of the experiences of people of color, specifically in education settings, are incomplete. Therefore, identifying methodological approaches that emphasize the perspectives of minoritized groups is essential. Counternarratives have been applied to help (re)tell stories of the oppressed to challenge dominant…

In this article, we reflect on our experiences with teaching ethnographic skills and sensibilities to MSc students at a Dutch university. Using methods such as (self)observation, journaling and reflection, we highlight dilemmas (conceptual, practical, ethical) faced by students when doing ethnographic fieldwork and dilemmas that emerged in…

Background: A systematic review is a type of literature review that uses rigorous methods to synthesize evidence from multiple studies on a specific topic. It is widely used in academia, including medical and social science research. Social science is an academic discipline that focuses on human behaviour and society. However, consensus regarding…

Pre-registration refers to the practice of researchers preparing a time-stamped document describing the plans for a study. This open research tool is used to improve transparency, so that readers can evaluate the extent to which the researcher adhered to their original plans and tested their theory appropriately. In the current study, we conducted…

Large language models (LLMs), through their exposure to massive collections of online text, learn to reproduce the perspectives and linguistic styles of diverse social and cultural groups. This capability suggests a powerful social scientific application--the simulation of empirically realistic, culturally situated human subjects. Synthesizing…

This study critically examines the biases and methodological shortcomings in studies comparing deaf and hearing populations, demonstrating their implications for both the reliability and ethics of research in deaf education. Upon reviewing the 20 most-cited deaf-hearing comparison studies, we identified recurring fallacies such as the presumption…

The evidence for a reproducibility crisis in the sciences is overwhelming. Nevertheless, this crisis has not received sufficient attention in kinesiology. This must be remedied for kinesiology research is as vulnerable to the problems of the reproducibility crisis as any other discipline. The causes of this crisis include human, statistical and…