Multiple Choice Questions (MCQs) are a popular assessment method because they enable automated evaluation, flexible administration and use with huge groups. Despite these benefits, the manual construction of MCQs is challenging, time-consuming and error-prone. This is because each MCQ is comprised of a question called the "stem", a…

Traditional cloze tests (such as the CBM-maze) may be poor measures of comprehension processes beyond the single sentence level. This paper presents an alternative, a deep cloze test with gaps that are strategically chosen to assess comprehension beyond the sentence level. To fill each gap, the reader has to draw global cohesion inferences during…

Learning to capitalize in English requires identifying a word's type and sentence position. In two cloze studies (2021-2022), Australian students of all genders (95% White, monolingual) spelled words with one and two capitalization cues (proper nouns, sentence-initial words) and no-cue control words. High school (12-18 years, n = 59) and…

Purpose: The aim of this study was to develop and validate a large Korean sentence set with varying degrees of semantic predictability that can be used for testing speech recognition and lexical processing. Method: Sentences differing in the degree of final-word predictability (predictable, neutral, and anomalous) were created with words selected…

Many students in the upper elementary grades and beyond uniquely struggle with reading comprehension, necessitating explicit instruction and remediation in this area. This U.S. study used data-based decision-making (DBDM), a research-based systematic approach to student data collection and analysis, to intensify the evidence-based Strategies for…

Cloze items are a foundational approach to assessing readability. However, they require human data collection, thus making them impractical in automated metrics. The present study revisits the idea of assessing readability with cloze items and compares human cloze scores and readability judgments with predictions made by T5, a popular deep…

In order to have a better understanding of the nature of reading behavior, it is quite essential to scrutinize the underlying assumptions of the two competing theories: the componential approach and unitary hypothesis and see how this is reflected on testing the reading skills. As a result, the current study was aimed at broadening the existing…

Research on L2 acquisition of the Spanish perfective and imperfective past has suggested that order-of-instruction (preterite before imperfect) may significantly contribute to learners' difficulty with mastering the imperfect. We sought to empirically test the effect of order-of-instruction by implementing a program-wide intervention in a beginner…

This paper presents a tool for creating student models in logistic regression. Creating student models has typically been done by expert selection of the appropriate terms, beginning with models as simple as IRT or AFM but more recently with highly complex models like BestLR. While alternative methods exist to select the appropriate predictors for…

This paper presents a tool for creating student models in logistic regression. Creating student models has typically been done by expert selection of the appropriate terms, beginning with models as simple as IRT or AFM but more recently with highly complex models like BestLR. While alternative methods exist to select the appropriate predictors for…

Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

While the effect of reading strategies on L2 test performance has been extensively researched, the effect of test-taking strategies remains underexplored, with mixed results due to varying contextual factors. This study, therefore, investigated the latent structure of test-taking strategies and the relationships among test-taking strategies,…

This contribution investigates gains in technical economy in measuring language ability by considering one recurrent interest of JD Brown: cloze tests. In the various versions of the Test of Academic Literacy Levels (TALL), its Sesotho and Afrikaans (Toets van Akademiese Geletterdheidsvlakke -- TAG) counterparts, as well as related other tests…

Local item dependence (LID) refers to the situation where responses to items in a test or questionnaire are influenced by responses to other items in the test. This could be due to shared prompts, item content similarity, and deficiencies in item construction. LID due to a shared prompt is highly probable in cloze tests where items are nested…

The ability to comprehend reading material is a crucial skill for academic and professional success, yet many students struggle with it, negatively impacting their academic performance. This study aimed to assess the effectiveness of AI-based personalised reading platforms in improving reading comprehension among senior high school students. The…