Item difficulty modeling studies involve (a) hypothesizing item features, or item response demands, that are likely to predict item difficulty with some degree of accuracy; and (b) entering the features as independent variables into a regression equation or other statistical model to predict difficulty. In this review, we report findings from 13…

This study examines the relationships among various major factors that may affect the difficulty level of language tests in an attempt to enhance the robustness of item difficulty estimation, which constitutes a crucial factor ensuring the equivalency of high-stakes tests. The observed difficulties of the reading and listening sections of two EFL…

This study aims to establish whether the processing of different connectives (e.g., "and," "but") and different coherence relations (addition, contrast) can be modulated by a structural feature of the connected segments--namely, parallelism. While "but" is mainly used to contrast two expressions, "and"…

We examine the effects of computer-based versus paper-based assessment of critical thinking skills, adapted from English (in the U.S.) to Chinese. Using data collected based on a random assignment between the two modes in multiple Chinese colleges, we investigate mode effects from multiple perspectives: mean scores, measurement precision, item…

In many reading comprehension tests, different test formats are employed. Two commonly used test formats to measure reading comprehension are sustained passages followed by some questions and cloze items. Individual differences in handling test format peculiarities could constitute a source of score variance. In this study, a bifactor Rasch model…

This article describes the development of an instrument to measure teachers' knowledge of vocabulary development and instruction, the Teacher Knowledge of Vocabulary Survey (TKVS). This type of knowledge has become increasingly important as all classroom teachers are expected to help students meet language and literacy standards that include…

Common Core Reading Standard 10 not only prescribes the difficulty of texts students should become able to read, but also the difficulty diet of texts schools should ask their students to read across the school year. The use of quantitative text-assessment tools in the implementation of this standard warrants an examination into the validity of…

Assessment of lexical/semantic knowledge is performed with a variety of tests varying in response requirements. The present study exemplifies the application of modern statistical approaches in the adaptation and assessment of the psychometric properties of the "Peabody Picture Vocabulary Test--Revised" (PPVT-R) Greek. Confirmatory…

The development of the Texas Assessment of Knowledge and Skills test involves input from educators across the state. The development process attempts to create an assessment that reflects the skills and content understanding of students at the tested grade level. This study attempts to determine other factors that can affect student performance on…

In this article, Maria Martiniello reports the findings of a study of the linguistic complexity of math word problems that were found to exhibit differential item functioning for English-language learners (ELLs) and non-ELLs taking the Massachusetts Comprehensive Assessment System (MCAS) fourth-grade math test. It builds on prior research showing…

This study examined characteristics of multiple-choice reading comprehension tasks suspected of influencing their difficulty, through administration of the California Achievement Tests to 158 deaf college students. Problem components evaluated included manifest content, psychologically salient features, and processing demands. Variation in item…

The construct validity of reading comprehension test items was studied in a two-stage process. Five characteristics of task difficulty were defined and a heterogeneous set of 52 items were rated for these characteristics. Then correlations were obtained between ratings and item difficulty data. (CTM)

Using informal, objectives-based, or linguistic methods, three elementary school teachers and three experienced item writers developed criterion-referenced pretests-posttests to accompany a prose passage. Item difficulites were tabulated on the responses of 364 elementary students. The informal-subjective method, used by many achievement test…

Recent assessment research joining cognitive psychology and psychometric theory has introduced a new technology, item generation. In algorithmic item generation, items are systematically created based on specific combinations of features that underlie the processing required to correctly solve a problem. Reading comprehension items have been more…

Test questions were phrased according to different sentence structures in a study of the complexity level of items for 220 third-grade children. Both the sensitivity of wh-questions (who, what, where, etc.) as a dependent variable and differences between wh-questions eliciting subject and predicate nouns were investigated. Effects of paraphrase…