Assessing the difficulty of reading comprehension questions is crucial to educational methodologies and language understanding technologies. Traditional methods of assessing question difficulty rely frequently on human judgments or shallow metrics, often failing to accurately capture the intricate cognitive demands of answering a question. This…

Text summarization is an effective reading comprehension strategy. However, summary evaluation is complex and must account for various factors including the summary and the reference text. This study examines a corpus of approximately 3,000 summaries based on 87 reference texts, with each summary being manually scored on a 4-point Likert scale.…

The assessment of writing proficiency generally includes analyses of the specific linguistic and rhetorical features contained in the singular essays produced by students. However, researchers have recently proposed that an individual's ability to flexibly adapt the linguistic properties of their writing might more closely capture writing skill.…

This demonstration introduces and presents an innovative online cognitive diagnostic assessment, developed to identify the types of cognitive processes that readers use during comprehension; specifically, processes that distinguish between subtypes of struggling comprehenders. Cognitive diagnostic assessments are designed to provide valuable…

This study focused on the use of a standardized reading assessment to examine reading comprehension among English language learners (ELLs) and English fluent middle school students, focusing on two text genres: informational and narrative. The Common Core State Standards require students to develop skills in both genres. However, ELLs may not…

We introduce a cognitive framework for measuring reading comprehension that includes the use of novel summary-writing tasks. We derive NLP features from the holistic rubric used to score the summaries written by students for such tasks and use them to design a preliminary, automated scoring system. Our results show that the automated approach…

Perspectives from reading and information fields have identified similar skills belong to two different kind of literacy being online reading abilities and ICT skills. It causes a conflict between two research fields and increase difficult of integrating study results. The purpose of this study was to determine which views are suitable for…

We assess the effect of automated formative evaluations on reading comprehension skills in a course of English for Specific Purposes (ESP) in the area of kinesiology at the Universidad Austral de Chile-Valdivia (UACh). The evaluations were implemented using Questionmark's Perception (QMP) (Questionmark-Corporation, 2015). We investigate: (1) Do…

This paper provides a discussion of the results of a cross-sectional examination of linguistic variables that are predicted to influence L2 reading fluency. This study is part of a larger, longitudinal mixed-methods study into reading fluency development using online Timed Reading (TR) with participants from a mid-to-high level private university…

An approach to scoring reading comprehension based on the concept of the testlet is described, using models developed for items in multiple categories. The model is illustrated using data from 3,866 examinees. Application of testlet scoring to multiple category models developed for individual items is discussed. (SLD)

Information provided for computerized adaptive test (CAT) simulees was compared under two conditions on two moderately correlated trait composites, mathematics and reading comprehension. The first condition used information provided by in-scale items alone, while the second condition used information provided by in- and out-of-scale items together…

This study investigated specific conditions under which out-of-scale information improves measurement precision and the factors that influence the degree of reliability gains and the amount of bias induced in the reported scores when out-of-scale information is used. In-scale information is information that an item provides for a composite trait…

More than 100 college students enrolled in a reading and study skills course participated in a study designed to show the effects of retrieval speed on adult reading comprehension. A microcomputer version of the Posner task was used to measure memory retrieval speed, and reading and listening comprehension were measured from McCall-Crabbs…

This paper describes the investigation of a computerized measure of reading rate as measured by the new Nelson-Denny Reading Test CD-ROM (1993). This study addressed three aspects of validity: (1) score comparability between reading rate measured by the computer version and the paper-and-pencil version; (2) concurrent validity with reading…

Methods to control the test construct and the efficiency of a computerized adaptive test (CAT) were studied in the context of a reading comprehension test given as a part of a battery of tests for college admission. A goal of the study was to create test scores that were interchangeable with those from a fixed form paper and pencil test. The first…