Multiple Choice Questions (MCQs) are a popular assessment method because they enable automated evaluation, flexible administration and use with huge groups. Despite these benefits, the manual construction of MCQs is challenging, time-consuming and error-prone. This is because each MCQ is comprised of a question called the "stem", a…

Automatic item generation may supply many items instantly and efficiently to assessment and learning environments. Yet, the evaluation of item quality persists to be a bottleneck for deploying generated items in learning and assessment settings. In this study, we investigated the utility of using large-language models, specifically Llama 3-8B, for…

While the effect of reading strategies on L2 test performance has been extensively researched, the effect of test-taking strategies remains underexplored, with mixed results due to varying contextual factors. This study, therefore, investigated the latent structure of test-taking strategies and the relationships among test-taking strategies,…

Local item dependence (LID) refers to the situation where responses to items in a test or questionnaire are influenced by responses to other items in the test. This could be due to shared prompts, item content similarity, and deficiencies in item construction. LID due to a shared prompt is highly probable in cloze tests where items are nested…

The ability to comprehend reading material is a crucial skill for academic and professional success, yet many students struggle with it, negatively impacting their academic performance. This study aimed to assess the effectiveness of AI-based personalised reading platforms in improving reading comprehension among senior high school students. The…

This study investigates the extent to which (a) Spanish heritage (HL) and second language (L2) writers' linguistic complexity differs across register contexts and (b) Spanish proficiency and writing motivational beliefs differentially affect HL and L2 writers' performance. Participants were 58 HL and 54 L2 Spanish learners who completed two…

This study explores the effectiveness of machine learning and eye movement features in predicting Chinese reading proficiency. Unlike previous research, which focused on one or two specific levels of eye movement features, this study integrates passage-, sentence- and word-level eye movement features to predict reading proficiency. By analyzing…

Reading disorders, including reading comprehension disorders, are among the most common referrals for evaluation in schools. If that evaluation involves individually administered tests of reading, the examiner is faced with selecting at least one reading comprehension subtest that is inherently associated with specific task demands, such as a…

We study how to automatically generate cloze questions from given texts to assess reading comprehension, where a cloze question consists of a stem with a blank space holder for the answer key, and three distractors for generating confusions. We present a generative method called CQG (Cloze Question Generator) for constructing cloze questions from…

Comprehenders generate expectations about upcoming lexical items in language processing using various types of contextual information. However, a number of studies have shown that argument roles do not impact neural and behavioral prediction measures. Despite these robust findings, some prior studies have suggested that lexical prediction might be…

This study addressed a gap in existing research on Multiple-Choice (MC) cloze tests by focusing on the learners' perspective, specifically examining the difficulties faced by vocational high school students (VHSs). A nationwide sample of 293 VHSs participated, providing both quantitative and qualitative data through a self-developed questionnaire.…

The deep cloze test was developed by Jensen and Elbro (Read Writ Interdiscip J 35(5):1221-1237, 2022. https://doi.org/10.1007/s11145-021-10230-w) to assess reading comprehension at the level of global situational understanding. In two independent studies, we examined potential contributors to students' scores on the deep cloze reading…

Cloze tests are commonly used in language testing as a quick measure of overall language ability or reading comprehension. A problem for the analysis of cloze tests with item response theory models is that cloze test items are locally dependent. This leads to the violation of the conditional or local independence assumption of IRT models. In this…

The purpose of this meta-analysis was to assess the overall effects of automaticity training of fundamental literacy component skills (i.e., letter names/sounds, individual words) on reading fluency and comprehension. Another purpose was to assess if the effects of automaticity training varied for reading fluency and comprehension. We identified…

This study investigated the extent to which second language (L2) learners benefited from proactive form-focused instruction (FFI) targeting French grammatical gender attribution and the degree to which L2 learners' attention control and working memory predicted their learning gains. A total of 102 L2 learners received either proactive FFI…