Testing programs are confronted with the decision of whether to report individual scores for examinees that have engaged in rapid guessing (RG). As noted by the "Standards for Educational and Psychological Testing," this decision should be based on a documented criterion that determines score exclusion. To this end, a number of heuristic…

Bayesian knowledge tracing model (BKT) is a typical student knowledge assessment method. It is widely used in intelligent tutoring systems. In the standard BKT model, all knowledge and skills are independent of each other. However, in the process of student learning, they have a very close relation. A student may understand knowledge B better when…

The purpose of this study was to conduct a conceptual replication of Pendergast et al.'s (2018) study that examined the diagnostic accuracy of a nomogram procedure, also known as a naive Bayesian approach. The specific naive Bayesian approach combined academic and social-emotional and behavioral (SEB) screening data to predict student performance…

Colleges have increasingly turned to predictive analytics to target at-risk students for additional support. Most of the predictive analytic applications in higher education are proprietary, with private companies offering little transparency about their underlying models. We address this lack of transparency by systematically comparing two…

Curriculum Associates' i-Ready is an adaptive diagnostic and individualized instructional tool that has been used in M-DCPS in the last few years. In addition, Curriculum Associates provides the District with results of their predictive model, which uses the students' outcomes on the Fall and Winter i-Ready diagnostic testing as well as the…

Bayesian Knowledge Tracing (BKT) is a commonly used approach for student modeling, and Long Short Term Memory (LSTM) is a versatile model that can be applied to a wide range of tasks, such as language translation. In this work, we directly compared three models: BKT, its variant Intervention-BKT (IBKT), and LSTM, on two types of student modeling…

Curriculum Associates' i-Ready is an adaptive diagnostic and individualized instructional tool that has been used in M-DCPS in the last few years. In addition, in 2016-2017, Curriculum Associates provided the District with results of their predictive model, which used the outcomes of the Fall and Winter i-Ready diagnostic testing to estimate the…

Northwest Evaluation Association™ (NWEA™) is committed to providing partners with useful tools to help make inferences from Measures of Academic Progress® (MAP®) interim assessment scores. One important tool is the concordance table between MAP and state summative assessments. Concordance tables have been used for decades to relate scores on…

Middle school math placement and progression are topics that are part of an active policy and practice discussion in California and elsewhere. Beginning in the 2008/09 school year, California's State Board of Education recommended that students complete algebra I by the end of grade 8. Between 2003 and 2009 the proportion of grade 8 students…

Concordance tables have been used for decades to relate scores on different tests measuring similar but distinct constructs. These tables, typically derived from statistical linking procedures, provide a direct link between scores on different tests and serve various purposes. Aside from describing how a score on one test relates to performance on…

As adaptive tutoring systems grow increasingly popular for the completion of classwork and homework, it is crucial to assess the manner in which students are scored within these platforms. The majority of systems, including ASSISTments, return the binary correctness of a student's first attempt at solving each problem. Yet for many teachers,…

Prior research has considered the sequential order of function words, after the contextual words of the text have been removed, as a stylistic indicator of authorship. This research describes an effort to enhance authorship attribution accuracy based on this same information source with alternate classifiers, alternate n-gram construction methods,…

Differential bundle functioning (DBF) analyses were conducted to determine whether seventh and eighth grade second language learners (SLLs) had lower probabilities of answering bundles of math word problems correctly that had heavy language demands, when compared to non-SLLs of equal math proficiency. Math word problems on each of four test forms…

Purpose: The purpose of the study was to investigate the individuals' dynamics of perceived control and hedonic tone over time, with respect to the 4 performance states as conceptualized within the multiaction plan (MAP) model. We expected to find idiosyncratic and differentiated trends over time in the scores of perceived control and hedonic…

Propensity score analysis (PSA) is a methodological technique which may correct for selection bias in a quasi-experiment by modeling the selection process using observed covariates. Because logistic regression is well understood by researchers in a variety of fields and easy to implement in a number of popular software packages, it has…