This simulation study was prompted by the current increased interest in linking national studies to international large-scale assessments (ILSAs) such as IEA's TIMSS, IEA's PIRLS, and OECD's PISA. Linkage in this scenario is achieved by including items from the international assessments in the national assessments on the premise that the average…

A large body of work has been devoted to reducing assessment biases that distort inferences about students' science understanding, particularly in multiple-choice instruments (MCI). Constructed-response instruments (CRI), however, have invited much less scrutiny, perhaps because of their reputation for avoiding many of the documented biases of…

Children's emergent literacy skills are highly predictive of later reading abilities. To determine which children have weaker emergent literacy skills and are in need of intervention, it is necessary to assess emergent literacy skills accurately and reliably. In this study, 1,351 children were administered the "Revised Get Ready to…

Previous mathematics and science education research indicates that knowledge and beliefs, including teaching efficacy, affect teachers' actions and effectiveness in a classroom. Our middle grades and high school Self-Efficacy to Teach Statistics (SETS) instruments, aligned with the statistical concepts in national and state guidelines such as the…

Although experimentally induced positive mood can generally last for 20 min and the induced mood is conducive to creative performance, it is still unclear whether the facilitation effect is stable during these 20 min. Two studies were conducted to examine this issue while controlling for the impacts of task switching, practice effect, and test…

Responses of 223 students in grades 6 to 11 to questions related to beliefs about getting out of bed on the left side are analysed from two perspectives. On one hand the items explore subjective beliefs about chance. On the other hand the different wording and context of the items provide opportunity to show different levels of understanding of…

Different estimation procedures have been developed for the unidimensional three-parameter item response theory (IRT) model. These techniques include the marginal maximum likelihood estimation, the fully Bayesian estimation using Markov chain Monte Carlo simulation techniques, and the Metropolis-Hastings Robbin-Monro estimation. With each…

As far as reading comprehension is concerned, background knowledge bears significance for English as a foreign language (EFL) learners who take high-stake tests such as M.A. University Entrance Examination. The reading part of this test can pose a challenge for Iranian EFL test takers, some of whom may have enough background knowledge to enhance…

Aim/Purpose: Teaching and learning is no longer the same and the paradigm shift has not settled yet. Information technology (IT) and its worldwide use impacts student learning methods and associated pedagogical models. Background: In this study we frame immersive learning as a method that we believe can be designed by pedagogical models such as…

The report is the first systematic evaluation of the sentence equivalence item type introduced by the "GRE"® revised General Test. We adopt a validity framework to guide our investigation based on Kane's approach to validation whereby a hierarchy of inferences that should be documented to support score meaning and interpretation is…

Translation is one of the items tested in many national English proficiency tests for non-English majors in China because translation competence is regarded as one of the productive language skills which could be used to assess learners' language proficiency. However, the feedback on translation exercises and self-tests are usually provided by…

The purpose of this article is to highlight the distinction between the reliability of test scores and the fit of psychometric measurement models, reminding readers why it is important to consider both when evaluating whether test scores are valid for a proposed interpretation and/or use. It is often the case that an investigator judges both the…

The Programme for International Assessment (PISA) is an important cross-national study of 15-year olds academic achievement. Although it has traditionally been conducted using paper-and-pencil tests, the vast majority of countries will use computer-based assessment from 2015. In this paper, we consider how cross-country comparisons of children's…

The research reported in this article investigates differential item functioning (DIF) in a listening comprehension test. The study explores the relationship between test-taker age and the items' language domains across multiple test forms. The data comprise test-taker responses (N = 2,861) to a total of 133 unique items, 46 items of which were…

Nationwide pre- and posttesting of introductory courses with the Geoscience Concept Inventory (GCI) shows little gain for many of its questions. Analysis of more than 3,500 tests shows that 22 of the 73 GCI questions had gains of <0.03, and nearly half of these focused on basic physics and chemistry. We also discovered through an assessment of…