This study presents a novel approach contributing to our understanding of the design, development, and implementation AI-based systems for conducting double-blind online randomized controlled trials (RCTs) for higher education research. The process of the entire interaction with the participants (n = 1193) and their allocation to test and control…

In this paper, we explore the role that examples play as mathematicians formulate conjectures, and we describe and exemplify one particular example-related activity that we observed in interviews with thirteen mathematicians. During our interviews, mathematicians productively used examples as they formulated conjectures, particularly by creating…

Jokes, cartoons, songs, and games can help engage students in discussion and learning key concepts about hypothesis testing.

A design experiment where students in Grade 5 (11-12 years old) play the Color Run game constitutes the context for investigating how students can be introduced to informal hypothesis testing. The result outlines a three-step hypothetical learning trajectory on informal hypothesis testing. In the first step, students came to favor sample space…

We investigate two non-iterative estimation procedures for Rasch models, the pair-wise estimation procedure (PAIR) and the Eigenvector method (EVM), and identify theoretical issues with EVM for rating scale model (RSM) threshold estimation. We develop a new procedure to resolve these issues--the conditional pairwise adjacent thresholds procedure…

Generating a testable hypothesis is a necessary skill for engaging in science, requiring both general reasoning skills and specific content knowledge of the phenomenon being investigated. While many students have the reasoning skills necessary for developing testable hypotheses in a general science context, it can be challenging for students to…

Quasi-experimental methods are a cornerstone of applied social science, providing critical answers to causal questions that inform policy and practice. Although open science principles have influenced experimental research norms across the social sciences, these practices are rarely implemented in quasi-experimental research. In this paper, we…

While national curricula in science education highlight the importance of inquiry-based learning, assessing students' capabilities in scientific inquiry remains a subject of debate. Our study explored the construction, developmental trends and validation techniques in relation to assessing scientific inquiry using a systematic literature review…

Research studies in Educational Data Mining (EDM) often involve several variables related to student learning activities. As such, it may be necessary to run multiple statistical tests simultaneously, thereby leading to the problem of multiple comparisons. The Benjamini-Hochberg (BH) procedure is commonly used in EDM research to address this…

In mixed methods approaches, statistical models are used to identify "nested" cases for intensive, small-n investigation for a range of purposes, including notably the examination of causal mechanisms. This article shows that under a commonsense interpretation of causal effects, large-n models allow no reliable conclusions about effect…

The aim of this study is to characterize ways of reasoning and arguing that first year university mathematics students exhibit in problem-solving activities from a course that emphasizes the importance of formulating conjectures and the search for different ways to support or validate them. The use of a Dynamic Geometry System in the…

Many of the methods commonly used to research mathematical practice, such as analyses of historical episodes or individual cases, are particularly well-suited to "generating" causal hypotheses, but less well-suited to "testing" causal hypotheses. In this paper we reflect on the contribution that the so-called…

For students with severe or complex challenging behavior, incorporating hypothesis testing as a component of functional behavior assessment (FBA) is often warranted. Several hypothesis testing strategies (i.e., functional analysis, antecedent analysis, concurrent operant analysis) can confirm whether and how features of a student's environment…

A modified and improved inductive inferential approach to evaluate item discriminations in a conditional maximum likelihood and Rasch modeling framework is suggested. The new approach involves the derivation of four hypothesis tests. It implies a linear restriction of the assumed set of probability distributions in the classical approach that…

Two independent statistical tests of item compromise are presented, one based on the test takers' responses and the other on their response times (RTs) on the same items. The tests can be used to monitor an item in real time during online continuous testing but are also applicable as part of post hoc forensic analysis. The two test statistics are…