We use Markov chain Monte Carlo (MCMC) analysis to construct a three-question math quiz to assess key skills needed for introductory finance. We begin with data collected from a ten-question criterion-referenced math quiz given to 314 undergraduates on the first day of class. MCMC indicates the top three questions for predicting overall course…

With the onset of online education via technology-enhanced learning platforms, large amount of educational data is being generated in the form of logs, clickstreams, performance, etc. These Virtual Learning Environments provide an opportunity to the researchers for the application of educational data mining and learning analytics, for mining the…

A multidimensional Bayesian item response model is proposed for modeling item position effects. The first dimension corresponds to the ability that is to be measured; the second dimension represents a factor that allows for individual differences in item position effects called persistence. This model allows for nonlinear item position effects on…

While Markov chains are widely used in business and industry, they are used within higher education only sporadically. Furthermore, when used to predict enrollment progression, most of these models use student level as the classification variable. This study uses grouped earned student credit hours to track the movement of students from one…

The purpose of this study is to assess the impact of aberrant responses on the estimation accuracy in forced-choice format assessments. To that end, a wide range of aberrant response behaviors (e.g., fake, random, or mechanical responses) affecting upward of 20%--30% of the responses was manipulated under the multi-unidimensional pairwise…

We propose a dyadic Item Response Theory (dIRT) model for measuring interactions of pairs of individuals when the responses to items represent the actions (or behaviors, perceptions, etc.) of each individual (actor) made within the context of a dyad formed with another individual (partner). Examples of its use include the assessment of…

The analysis of log data generated by online educational systems is an important task for improving the systems, and furthering our knowledge of how students learn. This paper uses previously unseen log data from Edulab, the largest provider of digital learning for mathematics in Denmark, to analyse the sessions of its users, where 1.08 million…

Severity and centrality are two main kinds of rater effects posing threats to the validity and fairness of performance assessments. Adopting Jin and Wang's (2018) extended facets modeling approach, we separately estimated the magnitude of rater severity and centrality effects in the web-based TestDaF (Test of German as a Foreign Language) writing…

This paper studies the use of Reinforcement Learning (RL) policies for optimizing the sequencing of online learning materials to students. Our approach provides an end to end pipeline for automatically deriving and evaluating robust representations of students' interactions and policies for content sequencing in online educational settings. We…

Higher education in America is characterized by widespread access to college but low rates of completion, especially among undergraduates at less selective institutions. We analyze longitudinal transcript data to examine processes leading to graduation, using Hidden Markov modeling. We identify several latent states that are associated with…

This study examines data from a field experiment investigating the effects of a personalized recommendation algorithm that proposes to students which videos to watch next, after they complete mini-assessments for algebra that available on the Math Nation intelligent virtual learning environment (IVLE). The end users of Math Nation are students…

The large-scale and granular interaction data collected in online learning platforms such as massive open online courses (MOOCs) provide unique opportunities to better understand individuals' learning processes and could facilitate the design of personalized and more effective support mechanisms for learners. In this paper, we present two…

Interest in Bayesian analysis of item response theory (IRT) models has grown tremendously due to the appeal of the paradigm among psychometricians, advantages of these methods when analyzing complex models, and availability of general-purpose software. Possible models include models which reflect multidimensionality due to designed test structure,…

Correct pronunciation significantly increases the intelligibility of communication. However, it is uncertain whether acquiring the pronunciation of the words enhances word retention capability. Therefore, the major purpose of this research is to evaluate whether vocabulary acquisition with the aid of pronouncing with artificial intelligence leads…

In this paper, we investigate two purported problems with Bayesian Knowledge Tracing (BKT), a popular statistical model of student learning: "identifiability" and "semantic model degeneracy." In 2007, Beck and Chang stated that BKT is susceptible to an "identifiability problem"--various models with different…