The main purpose of this quantitative-qualitative content analysis study was to compare IELTS and TOEFL listening and reading tests based on the representation of the learning objectives of Revised Bloom's taxonomy. To this end, 12 Academic IELTS listening and reading tests and 12 TOEFL iBT listening and reading tests were analyzed qualitatively…

Despite their significant contributions to research on self-regulated learning, those favoring online and trace approaches have questioned the use of self-report to assess learners' use of learning strategies. An important rejoinder to such criticisms consists of examining the validity of self-report items. The present study was designed to assess…

We examined multimodality (the representation of information in multiple semiotic modes) in the context of international test comparisons. Using Program of International Student Assessment (PISA)-2009 data, we examined the correlation of the difficulty of science items and the complexity of their illustrations. We observed statistically…

Open-ended (OE) items are widely used to gather data on student performance in international achievement studies. However, several factors may threaten validity when using such items. This study examined Finnish coders' opinions about threats to validity when coding responses to OE items in the PISA 2012 problem-solving test. A total of 6…

Teaching and assessing metacognitive activities are important educational objectives, and teachers are calling for efficient instruments. The advantages of questionnaires in measuring metacognitive activities are obvious, but serious validity issues appear. For example, correlations of questionnaire data with think-aloud measures are generally…

Most research on linguistic features of test items negatively impacting English language learners' (ELLs') performance has focused on lexical and syntactic features, rather than discourse features that operate at the level of the whole item. This mixed-methods study identified two discourse features in 162 multiple-choice items on a standardized…

Young children have an impressive amount of mathematics knowledge, but past psychological research has focused primarily on their number knowledge. Preschoolers also spontaneously engage in a form of early algebraic thinking-patterning. In the current study, we assessed 4-year-old children's knowledge of repeating patterns on two occasions…

Recent research (Strunk and Reardon forthcoming) applies Partial Independence Item Response (PIIR) models to teacher bargaining agreements in California to calculate the latent restrictiveness of these contracts. Further research (Strunk and Grissom 2010; Strunk forthcoming) tests the external validity of these estimates. Given that much research…

The purpose of this study is to explore the relationship between a set of item characteristics and the difficulty of TOEFL[R] dialogue items. Identifying characteristics that are related to item difficulty has the potential to improve the efficiency of the item-writing process The study employed 365 TOEFL dialogue items, which were coded on 49…

Purpose: The purpose of the two studies described in this paper was to assess whether adults with dementia could assume an advice-giving role (Study 1) and a teacher role (Study 2) despite their cognitive impairments. So far, no research on adults with dementia has compared language production in a social conversation condition with that in an…

The purpose of this study is to examine the content of the questions in a number of Advanced Placement Examinations and to attempt to identify content that is related to gender-based performance differences. Free-response questions for ten forms of the AP® Exams in U.S. History, European History, Biology, Microeconomics, and Macroeconomics were…