Multiple Choice Questions (MCQs) are a popular assessment method because they enable automated evaluation, flexible administration and use with huge groups. Despite these benefits, the manual construction of MCQs is challenging, time-consuming and error-prone. This is because each MCQ is comprised of a question called the "stem", a…

Traditional cloze tests (such as the CBM-maze) may be poor measures of comprehension processes beyond the single sentence level. This paper presents an alternative, a deep cloze test with gaps that are strategically chosen to assess comprehension beyond the sentence level. To fill each gap, the reader has to draw global cohesion inferences during…

Purpose: The aim of this study was to develop and validate a large Korean sentence set with varying degrees of semantic predictability that can be used for testing speech recognition and lexical processing. Method: Sentences differing in the degree of final-word predictability (predictable, neutral, and anomalous) were created with words selected…

Cloze items are a foundational approach to assessing readability. However, they require human data collection, thus making them impractical in automated metrics. The present study revisits the idea of assessing readability with cloze items and compares human cloze scores and readability judgments with predictions made by T5, a popular deep…

In order to have a better understanding of the nature of reading behavior, it is quite essential to scrutinize the underlying assumptions of the two competing theories: the componential approach and unitary hypothesis and see how this is reflected on testing the reading skills. As a result, the current study was aimed at broadening the existing…

This paper presents a tool for creating student models in logistic regression. Creating student models has typically been done by expert selection of the appropriate terms, beginning with models as simple as IRT or AFM but more recently with highly complex models like BestLR. While alternative methods exist to select the appropriate predictors for…

This paper presents a tool for creating student models in logistic regression. Creating student models has typically been done by expert selection of the appropriate terms, beginning with models as simple as IRT or AFM but more recently with highly complex models like BestLR. While alternative methods exist to select the appropriate predictors for…

Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

While the effect of reading strategies on L2 test performance has been extensively researched, the effect of test-taking strategies remains underexplored, with mixed results due to varying contextual factors. This study, therefore, investigated the latent structure of test-taking strategies and the relationships among test-taking strategies,…

This contribution investigates gains in technical economy in measuring language ability by considering one recurrent interest of JD Brown: cloze tests. In the various versions of the Test of Academic Literacy Levels (TALL), its Sesotho and Afrikaans (Toets van Akademiese Geletterdheidsvlakke -- TAG) counterparts, as well as related other tests…

Local item dependence (LID) refers to the situation where responses to items in a test or questionnaire are influenced by responses to other items in the test. This could be due to shared prompts, item content similarity, and deficiencies in item construction. LID due to a shared prompt is highly probable in cloze tests where items are nested…

The ability to comprehend reading material is a crucial skill for academic and professional success, yet many students struggle with it, negatively impacting their academic performance. This study aimed to assess the effectiveness of AI-based personalised reading platforms in improving reading comprehension among senior high school students. The…

This study investigates the extent to which (a) Spanish heritage (HL) and second language (L2) writers' linguistic complexity differs across register contexts and (b) Spanish proficiency and writing motivational beliefs differentially affect HL and L2 writers' performance. Participants were 58 HL and 54 L2 Spanish learners who completed two…

This study explores the effectiveness of machine learning and eye movement features in predicting Chinese reading proficiency. Unlike previous research, which focused on one or two specific levels of eye movement features, this study integrates passage-, sentence- and word-level eye movement features to predict reading proficiency. By analyzing…

The Mobile Fact and Concept Textbook System (MoFaCTS) is an individualized online tutoring system designed to increase information comprehension and retention. It is being implemented in community college anatomy and physiology (A&P) courses for further system development. A&P was selected because it is a very challenging and highly in…