Large language models (LLMs) provide cost-effective but possibly inaccurate predictions of human behavior. Despite growing evidence that predicted and observed behavior are often not "interchangeable," there is limited guidance on using LLMs to obtain valid estimates of causal effects and other parameters. We argue that LLM predictions…

In education settings, treatments are often non-randomly assigned to clusters, such as schools or classrooms, while outcomes are measured for students. This research design is called the clustered observational study (COS). We examine the consequences of common support violations in the COS context. Common support violations occur when the…

To date, there have been four responses (Dumas & Edelsbrunner, "Educational Psychology Review," 35, 48, 2023; Grosz, "Educational Psychology Review," 35, 57, 2023; Mayer, "Educational Psychology Review," 35, 64, 2023; Zitzmann et al., "Educational Psychology Review," 35, 65, 2023) to the Brady et al.…

Two- and three-level designs in educational and psychological research can involve entire populations of Level-3 and possibly Level-2 units, such as schools and educational districts nested within a given state, or neighborhoods and counties in a state. Such a design is of increasing relevance in empirical research owing to the growing popularity…

The rise of online proctoring potentially provides more opportunities for item harvesting and consequent brain dumping and shared "study guides" based on stolen content. This has increased the need for rapid approaches for evaluating and acting on suspicious test responses in every delivery modality. Both hiring proxy test takers and…

Joint attention (JA) is the purposeful coordination of an individual's focus of attention with that of another and begins to develop within the first year of life. Delayed, or atypically developing, JA is an early behavioural sign of many developmental disabilities and so assessing JA in infancy can improve our understanding of trajectories of…

Quantitative reasoning (QR) is a key skill for undergraduate biology education. Despite this, many students struggle with QR. Here, we use the theoretical framework of student noticing to investigate why some students struggle with QR in introductory biology labs. Under this framework, what students notice when given new information and data…

Educational reform priorities such as emphasis on quantitative modelling (QM) have positioned undergraduate biology instructors as designers of QM experiences to engage students in authentic science practices that support the development of data-driven and evidence-based reasoning. Yet, little is known about how biology instructors adapt to the…

The vast majority of research involving active learning pedagogies uses passive lecture methods as a baseline. We propose to move beyond such comparisons to understand the mechanisms that make different active learning styles unique. Here, we use COPUS observations to record student and instructor activities in six known styles of active learning…

This paper aims to bring into the ethical debate on covert research two aspects that are neglected to date: the perspective of the research subjects and the special responsibility of investigators towards their observers. Both aspects are falling behind, especially in quantitative social research. From a methodological point of view, quantitative…

Scholars of civil society organizations (CSOs) have long been concerned with face-to-face interactions among participants at meetings, events, and activities--what we collectively call "convenings." Small-N ethnographies have uncovered substantial differences in the dynamics of convenings within and across CSOs. Large-N quantitative…

As states consider non-academic measures of school quality for their accountability plans under the Every Student Succeeds Act, few are choosing to focus on the school climate in which students learn. That's not a surprise, given concerns about the validity and usefulness of existing climate surveys. However, the authors argue, a recent study…