In signal detection rater models for constructed response (CR) scoring, it is assumed that raters discriminate equally well between different latent classes defined by the scoring rubric. An extended model that relaxes this assumption is introduced; the model recognizes that a rater may not discriminate equally well between some of the scoring…

Intelligent Tutoring Systems (ITSs) have been developed to provide students with personalized learning experiences by adaptively generating learning paths optimized for each individual. Within the vast scope of ITS, score prediction stands out as an area of study that enables students to construct individually realistic goals based on their…

Knowledge tracing is a popular and successful approach to modeling student learning. In this paper we investigate whether the addition of neuroimaging observations to a knowledge tracing model enables accurate prediction of memory performance in held-out data. We propose a Hidden Markov Model of memory acquisition related to Bayesian Knowledge…

This article summarizes some of the technical issues that add to the complexity of language testing. It focuses in particular on the criterion-referenced nature of the ACTFL Proficiency Guidelines-Speaking; and it proposes a criterion-referenced interpretation of the ACTFL guidelines for reading and listening. It then demonstrates how using…

Reading comprehension is a complex task which depends on a range of cognitive and linguistic processes. According to the Simple View of Reading, this complexity can be captured as the product of two sets of skills: decoding and linguistic comprehension. The Simple View explains variance in reading comprehension and provides a good framework to…

In vocabulary research there has been a shift from focusing on single words to considering multiword sequences, such as collocations. Despite the general consensus among language researchers that collocation is essential to effective language use in real-world communication, particularly oral communication, language-testing researchers have made…

The issue and commentary papers in this "Perspectives" column address one use of assessments--speaking and writing proficiency assessments based on the American Council on the Teaching of Foreign Languages (ACTFL, 2012) Proficiency Guidelines--as a means for establishing and maintaining one important competency standard for world…

Alternative approaches are discussed for use of e-rater[R] to score the TOEFL iBT[R] Writing test. These approaches involve alternate criteria. In the 1st approach, the predicted variable is the expected rater score of the examinee's 2 essays. In the 2nd approach, the predicted variable is the expected rater score of 2 essay responses by the…