Although statistical practices to evaluate intervention effects in SCEDs have gained prominence in the recent times, models are yet to incorporate and investigate all their analytic complexities. Most of these statistical models incorporate slopes and autocorrelations both of which contribute to trend in the data. The question that arises is…

Randomized A/B tests allow causal estimation without confounding but are often under-powered. This paper uses a new dataset, including over 250 randomized comparisons conducted in an online learning platform, to illustrate a method combining data from A/B tests with log data from users who were not in the experiment. Inference remains exact and…

This study utilizes an analysis of diminishing returns to examine the relationship between sample size and item parameter estimation precision when utilizing the Masters' Partial Credit Model for polytomous items. Item data from the standardization of the Batelle Developmental Inventory, 3rd Edition were used. Each item was scored with a…

Computational thinking (CT) is a fundamental ability for learners in today's society. Although CT assessments and interventions have been studied widely, little is known about CT predictions. This study predicted students' CT achievement in the ICILS 2018 using five machine learning models. These models were trained on the data from five European…

Learning curves are an important tool in cognitive diagnostics modeling to help assess how well students acquire new skills, and to refine and improve knowledge component models. Learning curves are typically obtained from a model estimated on real data obtained from a finite, and usually limited, sample of students. As a consequence, there is…

Educational systems use models of student skill to inform decision-making processes. Defining such models manually is challenging due to the large number of relevant factors. We propose learning multidimensional representations (embeddings) from student activity data -- these are fixed-length real vectors with three desirable characteristics:…

The development of mathematical reasoning is a key proficiency for mathematics within the Australian Curriculum. However, reasoning can be difficult for teachers to assess, particularly with pen and paper tests. In this study, interview tasks were designed across three curriculum areas at three different levels to assess student reasoning through…

In Bayesian structural equation modeling (BSEM), prior settings may affect model fit, parameter estimation, and model comparison. This simulation study was to investigate how the priors impact evaluation of relative fit across competing models. The design factors for data generation included sample sizes, factor structures, data distributions, and…

Student modeling is useful in educational research and technology development due to a capability to estimate latent student attributes. Widely used approaches, such as the Additive Factors Model (AFM), have shown satisfactory results, but they can only handle binary outcomes, which may yield potential information loss. In this work, we propose a…

Computational models of learning can be powerful tools to test educational technologies, automate the authoring of instructional software, and advance theories of learning. These mechanistic models of learning, which instantiate computational theories of the learning process, are capable of making predictions about learners' performance in…

In this study, we fitted a mixed-effects nonlinear continuous-time mutualism model of skill development proposed by van der Maas et al. (2006) to naturally collected irregularly spaced time series data from an online adaptive practice system for mathematics called Math Garden. Results showed that the mutualism model provided a better fit to the…

Consistency of learning behaviors is known to play an important role in learners' engagement in a course and impact their learning outcomes. Despite significant advances in the area of learning analytics (LA) in measuring various self-regulated learning behaviors, using LA to measure consistency of online course engagement patterns remains largely…

Contemporary teacher evaluation systems are built upon multiple measures including, primarily, teacher-level value-added and observational estimates. While researchers have conducted examinations of these systems and indicators, researchers have not investigated how using these systems might distort the validity of the inferences being drawn,…

A key affordance of game-based learning environments is their potential to unobtrusively assess student learning without interfering with gameplay. In this paper, we introduce a temporal analytics framework for stealth assessment that analyzes students' problem-solving strategies. The strategy-based temporal analytic framework uses long short-term…

Knowledge tracing is a fundamental area of educational data modeling that aims at gaining a better understanding of the learning occurring in tutoring systems. Knowledge tracing models fit various parameters on observed student performance and are evaluated through several goodness of fit metrics. Fitted parameter values are of crucial interest in…