Assessing the difficulty of reading comprehension questions is crucial to educational methodologies and language understanding technologies. Traditional methods of assessing question difficulty rely frequently on human judgments or shallow metrics, often failing to accurately capture the intricate cognitive demands of answering a question. This…

Idioms abound in both spoken and written English, yet they present a particularly thorny problem in foreign language learning. One of the reasons for this difficulty is second language learners' ignorance of the holistic nature of English idioms. Based on computerized reading tasks, the present study probes the effects of using electronic glosses…

We examine the effects of computer-based versus paper-based assessment of critical thinking skills, adapted from English (in the U.S.) to Chinese. Using data collected based on a random assignment between the two modes in multiple Chinese colleges, we investigate mode effects from multiple perspectives: mean scores, measurement precision, item…

As reading and reading assessment become increasingly implemented on electronic devices, the question arises whether reading on screen is comparable with reading on paper. To examine potential differences, we studied reading processes on different proficiency and complexity levels. Specifically, we used data from the standardization sample of the…

This study reports 2 eye-tracking experiments investigating form interference during sentence-level silent reading. The items involved reduced and unreduced relative clauses (RCs) with words that were orthographically and phonologically similar "(injection-infection"; O+P+, Experiment 1) as well as with words that were orthographically…

The "TOEFL"® family of assessments includes the "TOEFL"® Primary"™, "TOEFL Junior"®, and "TOEFL iBT"® tests. The linguistic complexity of stimulus passages in the reading sections of the TOEFL family of assessments is expected to differ across the test levels. This study evaluates the linguistic…

Derived from Vygotsky's works, dynamic assessment (DA) enables learners to move beyond their current level of functioning through offering needs-sensitized mediation. This study aimed at exploring the learners' development in novel and increasingly more challenging situations called transcendence (TR) in an L2 context focusing on reading…

This study uses a moving windows self-paced reading task to assess both text comprehension and processing time of authentic texts and these same texts simplified to beginning and intermediate levels. Forty-eight second language learners each read 9 texts (3 different authentic, beginning, and intermediate level texts). Repeated measures ANOVAs…

This study investigated the reading behavior of 15-year-old students while reading texts and answering corresponding multiple-choice questions. The availability of the texts during question answering was manipulated experimentally. Allocation of resources to several cognitive processes at the word, sentence, and text level was measured by…

The Common Core State Standards for English Language Arts (CCSS/ELA) focus on building student capacity to read complex texts. The Standards provide an explicit text complexity staircase that maps text levels to grade levels. Furthermore, the Standards articulate a rationale to accelerate text levels across grades to ensure students are able to…

To explore whether different balances of fiction/non-fiction reading and challenge might help explain differences in reading achievement between genders, data on 45,670 pupils who independently read over 3 million books were analysed. Moderate (rather than high or low) levels of challenge were positively associated with achievement gain, but…

Studied the cognitive equivalence of computerized and paper-and-pencil reading comprehension tests using verbal protocol analysis. Results for 48 college students indicate that the only significant difference between the computerized and paper-and-pencil tests was in the frequency of identifying important information in the passage. (SLD)

This collection of essays on measurement theory and language testing includes: "Computerized Adaptive Testing: Implications for Language Test Developers" (Peter Tung); "The Promise and Threat of Computerized Adaptive Assessment of Reading Comprehension" (Michael Canale); "Computerized Rasch Analysis of Item Bias in ESL…