Evidence-based education aims to support policy makers choosing between potential interventions. This rarely involves considering each in isolation; instead, sets of evidence regarding many potential policy interventions are considered. Filtering a set on any quantity measured with error risks the "winner's curse": conditional on…

Composite scores are an exceptionally important psychometric tool for behavioral science research applications. A prototypical example occurs with self-report data, where researchers routinely use questionnaires with multiple items that tap into different features of a target construct. Item-level missing data are endemic to composite score…

Since the first descriptions of design research (DR), there have been calls to better define it to increase its rigour. Yet five uncertainties remain: (1) the processes for conducting DR, (2) how DR differs from other forms of research, (3) how DR differs from design, (4) the products of DR, and (5) why DR can answer certain research questions…

In John Raven's "Diving in Where Angels Fear to Tread: Pre-Requisites to Evidence-Based Interventions," he outlines several critical failings in which social scientists bear a responsibility for potentially a great deal of damage toward children, society, and notably, the planet itself. The nature of the damage appears to be one of…

This paper evaluates the use of Factor Analysis (FA) in English education research in Korea and suggests improvements in methodology. A detailed coding protocol was used to review 179 FA cases from 12 major English education journals (2014-2023). The review identified several key issues, including small sample sizes and lenient criteria for sample…

Educational research enquiries differ based on philosophical beliefs and assumptions regarding researchers' explicitly stated views. This paper critically explores the most dominant philosophical stances in social research sciences, namely positivism, interpretivism and pragmatism. It begins with an overview of the role of the aforementioned…

Manipulation checks are an essential component of quality experimental design in motor learning. Guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework, this methodological systematic review examined the utilization of manipulation checks in focus of attention research. Seventy-eight protocols from four…

Concerns about the conduct of research are pervasive in many fields, including education. In this preregistered study, we replicated and extended previous studies from other fields by asking education researchers about 10 questionable research practices and five open research practices. We asked them to estimate the prevalence of the practices in…

When scientists act unethically, their actions can cause harm to participants, undermine knowledge creation, and discredit the scientific community. Responsible Conduct of Research (RCR) training is one of the main ways institutions try to prevent scientists from acting unethically. However, this only addresses the problem if scientists value the…

Longitudinal panel studies are widely used in developmental science to address important research questions on human development across the lifespan. These studies, however, are often challenging to implement. They can be costly, time-consuming, and vulnerable to test--retest effects or high attrition over time. Planned missingness designs (PMDs),…

Judgments of learning (JOLs) play a fundamental role in helping learners regulate their study strategies but are susceptible to various kinds of illusions and biases. These can potentially impair learning efficiency, and hence understanding the mechanisms underlying the formation of JOLs is important. Many studies have suggested that both…

In this commentary, we argue that literacy research would be more productive if researchers had a clearer, more nuanced understanding of theory. Specifically, we argue that theory in a practice-oriented field is most fundamentally productive when it provides instrumental guidance for literacy beyond academic understanding about literacy. Premises…

Bowers ("Educational Psychology Review," 32, 681-705, 2020) reviewed 12 meta-analytic syntheses addressing the effects of phonics instruction, concluding that the evidence is weak to nonexistent in supporting the superiority of systematic phonics to alternative reading methods. We identify five issues that limit Bowers' conclusions: (1)…

Since the early 2000s, the proliferation of cameras, whether in mobile phones or CCTV, led to a sharp increase in visual recordings of human behavior. This vast pool of data enables new approaches to analyzing situational dynamics. Application is both qualitative and quantitative and ranges widely in fields such as sociology, psychology,…

Purpose: The purpose of this paper is to explore the role of claims of cultural appropriation in negotiating who has the right to utilise specific racial, cultural or communities' ways of knowing in research co-production. Cultural appropriation is a claim made against those making illegitimate use of traditions, knowledge and practises that…