Online educational technologies facilitate pedagogical experimentation, but typical experimental designs assign a fixed proportion of students to each condition, even if early results suggest some are ineffective. Experimental designs using multi-armed bandit (MAB) algorithms vary the probability of condition assignment for a new student based on…

Randomized A/B tests allow causal estimation without confounding but are often under-powered. This paper uses a new dataset, including over 250 randomized comparisons conducted in an online learning platform, to illustrate a method combining data from A/B tests with log data from users who were not in the experiment. Inference remains exact and…

Large-scale, classroom-based experiments using adaptive instructional software pose somewhat unique challenges for experimental design and deployment. One reason for this is that adaptive software allows students to advance through the curriculum at different rates and encounter content at different times, meaning that content targeted for…

As online learning platforms become more ubiquitous throughout various curricula, there is a growing need to evaluate the effectiveness of these platforms and the different methods used to structure online education and tutoring. Towards this endeavor, some platforms have performed randomized controlled experiments to compare different user…

As online learning platforms become more ubiquitous throughout various curricula, there is a growing need to evaluate the effectiveness of these platforms and the different methods used to structure online education and tutoring. Towards this endeavor, some platforms have performed randomized controlled experiments to compare different user…

Tallman (2015) argued that pedagogical content knowledge is a form of content knowledge with particular characteristics that endow it with pedagogical utility, and he conjectured that an essential characteristic of a teacher's content knowledge is her conscious awareness of the mental actions and conceptual operations that comprise her…

Personalized learning considers that the causal effects of a studied learning intervention may differ for the individual student. Making the inference about causal effects of studies interventions is a central problem. In this paper we propose the Residual Counterfactual Networks (RCN) for answering counterfactual inference questions, such as…

Creativity is a relevant skill for human beings in order to overcome complex problems and reach novel solutions based on unexpected associations of concepts. Thus, the education of creativity becomes relevant, but there are not tools to automatically track the creative potential of learners over time. This work provides a novel set of behavioural…

The paper focuses on student-teachers' geometric diagrams to mediate the emergence of different proofs for a geometric proposition. For Peirce, a diagram is an icon that explicitly and implicitly represents the deep structural relations among the parts of the object that it stands for. Geometric diagrams can be seen as epistemological tools to…

This paper presents results from three teaching experiments intended to guide students to reinvent truth-functional interpretations for mathematical disjunctions. The initial teaching experiments revealed that students' emergent strategies for assessing disjunctions did not entail or facilitate the development of a relevant partitioning of example…

Continuously tracking students during a whole semester plays a vital role to enable a teacher to grasp their learning situation, attitude and motivation. It also helps to give correct assessment and useful feedback to them. To this end, we ask students to write their comments just after each lesson, because student comments reflect their learning…

This paper presents a hybrid approach for correcting grammatical errors in the sentences uttered by Korean learners of English. The error correction system plays an important role in GenieTutor, which is a dialogue-based English learning system designed to teach English to Korean students. During the talk with GenieTutor, grammatical error…

Predicting the success or failure of a student in a course or program is a problem that has recently been addressed using data mining techniques. In this paper we evaluate some of the most popular classification and regression algorithms on this problem. We address two problems: prediction of approval/failure and prediction of grade. The former is…

Quek, Tay, Toh, Leong, and Dindyal (2011) proposed that a design-theory-practice troika should always be considered for a designed package to be acceptable to the research users who, in this case, are teachers and schools. This paper describes the fine-tuning to the MProSE problem-solving design made by the teachers in the school after first round…

This paper reports on a study that examines the effects of problem context on students' performance. The performance of 151 Year 10 students on six mathematical problems was compared with the performance on fifteen variants with more and less context familiarity (CF) and engagement (CE) across levels of context use (LCU). The latter explanatory…