Background: Studies of syntactic comprehension and reading comprehension use a wide range of syntactic comprehension tests that vary considerably in format. The goal of this study was to examine to which extent different formats of syntactic comprehension tests measure the same construct. Methods: Sixty-nine Grade 4 students completed multiple…

This study examined the significance of the mode of delivery--aural versus written--in second language (L2) vocabulary knowledge and L2 comprehension skills. One of the unique aspects of listening comprehension that sets it apart from reading comprehension is the mode of delivery--language input is delivered not visually but aurally. Somewhat…

The use of digital environments for both learning and assessment is becoming prevalent. This often leads to incongruent situations, in which the study medium (eg, printed textbook) is different from the testing medium (eg, online multiple-choice exams). Despite some evidence that incongruent study-test situations are associated with inferior…

We compared high school students' performance in a traditional comprehension assessment requiring them to identify key information and draw inferences from single texts, and a scenario-based assessment (SBA) requiring them to integrate, evaluate and apply information across multiple sources. Both assessments focused on a non-academic topic.…

This study was to compare the processes that second language learners implemented when completing reading tasks in a multiple-choice question format (MCQ) with those in a short-answer question format (SAQ). Sixteen nonnative English-speaking students from a large Midwestern college in the United States were invited to complete MCQ and SAQ English…

We examine the effects of computer-based versus paper-based assessment of critical thinking skills, adapted from English (in the U.S.) to Chinese. Using data collected based on a random assignment between the two modes in multiple Chinese colleges, we investigate mode effects from multiple perspectives: mean scores, measurement precision, item…

Studies have shown that reading comprehension is the most difficult section of the Paper-Based Test (PBT) TOEFL. Therefore, this research aimed to identify which sub-skill in reading comprehension poses the greatest challenges for the students and how this sub-skill correlates to other reading comprehension sub-skills. To achieve this purpose,…

Notwithstanding the introduction of education multilingual policies worldwide, testing and assessment procedures still rely almost exclusively on the monolingual construct. This paper describes a study, part of a larger project fostering a new multilingual education policy in Israeli schools, exploring bi/multilingual assessment. It included two…

Reading comprehension tests are often assumed to measure the same, or at least similar, constructs. Yet, reading is not a single but a multidimensional form of processing, which means that variations in terms of reading material and item design may emphasize one aspect of the construct at the cost of another. The educational systems in Denmark,…

Premised on Web 2.0 technology, the current study investigated the effect of facilitating critical thinking using the Collaborative Questioning, Reading, Answering, and Checking (C-QRAC) collaboration script on university students' science reading literacy in flipped learning conditions. Participants were 85 Taiwanese university students recruited…

In many reading comprehension tests, different test formats are employed. Two commonly used test formats to measure reading comprehension are sustained passages followed by some questions and cloze items. Individual differences in handling test format peculiarities could constitute a source of score variance. In this study, a bifactor Rasch model…

Previous studies (Collins, 2015; Kennan & Meenan, 2014) have shown how variations in text and task factors and individual reader skills affect performance on reading comprehension assessments. The present study examined whether different presentation conditions (silent reading, watching a video) and response formats (open-ended vs.…

The "TOEFL"® family of assessments includes the "TOEFL"® Primary"™, "TOEFL Junior"®, and "TOEFL iBT"® tests. The linguistic complexity of stimulus passages in the reading sections of the TOEFL family of assessments is expected to differ across the test levels. This study evaluates the linguistic…

In this article we discuss how apparently indicators that may appear straightforward, such as gender differences, need to be interpreted with extreme care. In particular, we consider how the assessment framework, and the methodology of international surveys, may have a potential impact on the results and on the indicators. Through analysis of…

A Markov chain Monte Carlo (MCMC) method and a bootstrap method were compared in the estimation of standard errors of item response theory (IRT) true score equating. Three test form relationships were examined: parallel, tau-equivalent, and congeneric. Data were simulated based on Reading Comprehension and Vocabulary tests of the Iowa Tests of…