The presented article is dedicated to a new way of teaching substitution in algebra. In order to effectively master the subject matter, it is necessary for students to perceive the equal sign equivalently, to learn to manipulate expressions as objects, and to perceive and use transformations based on defining their own equivalences. According to…

Randomized A/B tests allow causal estimation without confounding but are often under-powered. This paper uses a new dataset, including over 250 randomized comparisons conducted in an online learning platform, to illustrate a method combining data from A/B tests with log data from users who were not in the experiment. Inference remains exact and…

In this paper, we present data from two iterative teaching experiments involving students' constructions of four basic counting problems. The teaching experiments were designed to leverage the generalizing activities of relating and extending to provide students with opportunities to reflect on initial combinatorial activity when constructing…

The advent of data science has led to statistics education researchers re-thinking and expanding their ideas about tools for teaching statistical modeling, such as the use of code-driven tools at the secondary school level. Methods for statistical inference, such as the randomization test, are typically taught within secondary school classrooms…

Education experiments frequently assign students to treatment or control conditions within schools. Longitudinal components added in these studies (e.g., students followed over time) allow researchers to assess treatment effects in average rates of change (e.g., linear or quadratic). We provide methods for a priori power analysis in three-level…

Personalized learning considers that the causal effects of a studied learning intervention may differ for the individual student. Making the inference about causal effects of studies interventions is a central problem. In this paper we propose the Residual Counterfactual Networks (RCN) for answering counterfactual inference questions, such as…

Creativity is a relevant skill for human beings in order to overcome complex problems and reach novel solutions based on unexpected associations of concepts. Thus, the education of creativity becomes relevant, but there are not tools to automatically track the creative potential of learners over time. This work provides a novel set of behavioural…

Field experiments in education frequently assign entire groups such as schools to treatment or control conditions. These experiments incorporate sometimes a longitudinal component where for example students are followed over time to assess differences in the average rate of linear change, or rate of acceleration. In this study, we provide methods…

Conflicting explanations and unrelated information in science classrooms increase cognitive load and decrease efficiency in learning. This reduced efficiency ultimately limits one's ability to solve reasoning problems in the science. In reasoning, it is the ability of students to sift through and identify critical pieces of information that is of…

This article summarizes a conceptual framework and simple mathematical methods of estimating the probability that one event was a necessary cause of another, as interpreted by lawmakers. We show that the fusion of observational and experimental data can yield informative bounds that, under certain circumstances, meet legal criteria of causation.…

In this paper, we study how to support a human tutor who regulates learners' activities, in a situation of mediated tutoring. Our goal is to provide the tutor with information about the effect of his/her interventions. To achieve this, we adopt an indicator-based approach and define the notion of meta-indicator. The distinguishing feature of…

A repeated crossover experiment comparing learning among students handing in pen-and-paper homework (PPH) with students handing in web-based homework (WBH) has been conducted. The system used in the experiments, the tutor-web, has been used to deliver homework problems to thousands of students in mathematics and statistics over several years.…

The terms "concreteness fading" and "progressive formalization" have been used to describe instructional approaches to science and mathematics that use grounded representations to introduce concepts and later transition to more formal representations of the same concepts. There are both theoretical and empirical reasons to…

When evaluators plan site-randomized experiments, they must conduct the appropriate statistical power analyses. These analyses are most likely to be valid when they are based on data from the jurisdictions in which the studies are to be conducted. In this method note, we provide software code, in the form of a SAS macro, for producing statistical…

The representation of numbers is commonly viewed as an ordered continuum of magnitudes, referred to as the "mental number line." Previous work has repeatedly shown that number representations evoked by a given task can be easily altered, yielding an ongoing discussion about the basic properties of the mental number line and how malleable…