This paper reports on literature related to the assessment of barriers to educational technology assessment. It surveys the development of technology acceptance models from social cognitive theory and innovation diffusion theory through to a unified theory that considers performance expectancy, effort expectancy, and social influence. Because risk…

Bayesian Knowledge Tracing, a model used for cognitive mastery estimation, has been a hallmark of adaptive learning research and an integral component of deployed intelligent tutoring systems (ITS). In this paper, we provide a brief history of knowledge tracing model research and introduce pyBKT, an accessible and computationally efficient library…

In this paper, we offer a novel framework for analyzing the Opportunities for Reasoning-and-Proving (ORP) in mathematical tasks. By drawing upon some tenets of the commognitive framework, we conceptualize learning and teaching mathematics via reasoning and proving both as enacting reasoning processes (e.g., conjecturing, justifying) in the…

Selecting courses in an open-curriculum education program is a difficult task for students and academic advisors. Course recommendation systems nowadays can be used to reduce the complexity of this task. To control the recommendation error, we argue that course recommendations need to be provided together with "statistical" confidence.…

The Elo rating system has been recognised as an effective method for modelling students and items within adaptive educational systems. The existing Elo-based models have the limiting assumption that items are only tagged with a single concept and are mainly studied in the context of adaptive testing systems. In this paper, we introduce a…

Large language models (LLMs), such as Codex, hold great promise in enhancing programming education by automatically generating feedback for students. We investigate using LLMs to generate feedback for fixing syntax errors in Python programs, a key scenario in introductory programming. More concretely, given a student's buggy program, our goal is…

In the last twenty-five years, the discussion surrounding validity evidence has shifted both in language and scope, from the work of Messick and Kane to the updated Standards for Educational and Psychological Testing. However, these discussions haven't necessarily focused on best practices for different types of instruments or assessments, taking…

Verification and validation are essential aspects of mathematics and beyond in STEM, but these constructs are not consistently defined in research nor in curricula documents. In this theoretical paper, we argue that verification and validation are largely characterized as binary judgments by teachers and researchers about what students do. We then…

When designing an instructional tool and using it in pedagogical activities, it is essential that designers and users understand what pedagogical affordances and constraints the tool provides to support its successful integration into targeted pedagogical activities. Toward this end, we developed "Pedagogical Affordance Analysis (PAA)."…

Short forms of psychometric scales have been commonly used in educational and psychological research to reduce the burden of test administration. However, it is challenging to select items for a short form that preserve the validity and reliability of the scores of the original scale. This paper presents and evaluates multiple automated methods…

The scientific rigor of education research has improved dramatically since the year 2000. Much of the credit for this improvement is deserved by Institute of Education Sciences (IES) policies that helped create a demand for rigorous research; increased human capital capacity to carry out such work; provided funding for the work itself; and…

Is good reasoning in the moral domain different from its counterpart in non-moral domains? What counts as a good moral argument, or a valid moral assertion or claim? What does 'validity' mean in the moral realm? Lots of ink has been spilled on these and related questions in the past few decades, but not much has been settled. In what follows I…

The Additive Factor Model (AFM) is a cognitive diagnostic model that can be used to predict student performance on items in a context that allows for student learning. Within AFM, "skills" have a learning rate, and student acquisition of a skill depends only on the number of opportunities a student has had to exercise that skill and the…

In this theoretical article, I examine the norms of teacher professional development with an eye towards modifying them to allow for genuine systemic change. I first argue that current norms restrict professional development practice to "pseudo-activity" which necessarily operates within rather than against larger societal structures. I…

Calls for replication studies are becoming more frequent, and Computer Assisted Language Learning (CALL) has now reached sufficient maturity to offer numerous studies that lend themselves to replication. Realistic and successful replications rely on transparency in terms of data, results, and methodology. Two published studies in the area of…