This study incorporates a random forest (RF) approach to probe complex interactions and nonlinearity among predictors into an item response model with the goal of using a hybrid approach to outperform either an RF or explanatory item response model (EIRM) only in explaining item responses. In the specified model, called EIRM-RF, predicted values…

In recent ACT mode comparability studies, students testing on laptop or desktop computers earned slightly higher scores on average than students who tested on paper, especially on the ACT® reading and English tests (Li et al., 2017). Equating procedures adjust for such "mode effects" to make ACT scores comparable regardless of testing…

As reading and reading assessment become increasingly implemented on electronic devices, the question arises whether reading on screen is comparable with reading on paper. To examine potential differences, we studied reading processes on different proficiency and complexity levels. Specifically, we used data from the standardization sample of the…

The computer-administered Multiple-Choice Online Causal Comprehension Assessment (MOCCA) for Grades 3 to 5 has an innovative, 40-item multiple-choice structure in which each distractor corresponds to a comprehension process upon which poor comprehenders have been shown to rely. This structure requires revised thinking about measurement issues…

The computer-administered Multiple-Choice Online Causal Comprehension Assessment (MOCCA) for Grades 3 to 5 has an innovative, 40-item multiple-choice structure in which each distractor corresponds to a comprehension process upon which poor comprehenders have been shown to rely. This structure requires revised thinking about measurement issues…

This quantitative study examined seventh-grade reading scores to determine the extent to which certain demographic variables (race/ethnicity, gender, socioeconomic status) explain and MAP reading scores predict reading scores on the State of Texas Assessment of Academic Readiness (STAAR) in a selected northeast Texas public school. Standardized…

The goal of this study was to investigate the nature of online comprehension monitoring, its predictors, and its relation to reading comprehension. Questions were concerned with (a) beginning readers' sensitivity to inconsistencies, (b) predictors of online comprehension monitoring, and (c) the relation of online comprehension monitoring to…

The goal of this study was to investigate the nature of online comprehension monitoring, its predictors, and its relation to reading comprehension. Questions were concerned with (a) beginning readers' sensitivity to inconsistencies, (b) predictors of online comprehension monitoring, and (c) the relation of online comprehension monitoring to…

A recent Educational Testing Services report (2016) found that international graduate students with a TOEFL score of 80--the minimum average TOEFL score for graduate admission in the United States--usually possess reading subscores of 20, equating to a 12th-grade reading comprehension level. However, one public flagship university's international…

We explored the feasibility of using automated scoring to assess upper-elementary students' reading ability through analysis of transcripts of students' small-group discussions about texts. Participants included 35 fourth-grade students across two classrooms that engaged in a literacy intervention called Quality Talk. During the course of one…

We explored the feasibility of using automated scoring to assess upper-elementary students' reading ability through analysis of transcripts of students' small-group discussions about texts. Participants included 35 fourth-grade students across two classrooms that engaged in a literacy intervention called Quality Talk. During the course of one…

In preparation for online administration of the ACT® test, ACT conducted studies to examine the comparability of scores between online and paper administrations, including a timing study in fall 2013, a mode comparability study in spring 2014, and a second mode comparability study in spring 2015. This report presents major findings from these…

This paper examines how different test methods may tap different aspects of second language knowledge. It employs multiple-choice (MC) and constructed response (CR) items which yield distinct or convergent information in the computer delivered testing of English in its presentation of this factor. In order to examine the effects of test method, a…

The Progress in International Reading Literacy Study (PIRLS) is an international assessment of student performance in reading literacy at the fourth grade. PIRLS measures students in the fourth year of formal schooling because this is typically when students' learning transitions from a focus on "learning to read" to a focus on…

This article examines the effectiveness of a software that supports formative assessment in real-time of learners' vocabulary knowledge through an interactive highlighting method. Students in a classroom are given a passage on their computer screen and asked to highlight the words they do not understand. This information is summarized on the…