We explore whether the item characteristics of four-response multiple-choice questions with "paired" (non-independent) response options differ from those with unpaired response options in an operational licensure exam in terms of guessing behavior. Our analyses suggest that they do not. We discuss conditions where response pairing might…

The Partnership for Assessment of Readiness for College and Careers (PARCC) is a group of states working together to develop a set of assessments that measure whether students are on track to be successful in college and careers. Administrations of the PARCC assessment included three Prose Constructed Responses (PCR), one per task for English…

Elementary school students often exhibit a variety of conceptions associated with algebraic thinking that their teachers fail to recognize or understand. It is crucial that elementary school teachers possess knowledge of the variety of student conceptions and also have abilities to address varying states of conceptions. Otherwise, students who are…

Background: This paper extends a recent study by Kaplan and Su ("J Educ Behav Stat" 41: 51-80, 2016) examining the problem of matrix sampling of context questionnaire scales with respect to the generation of plausible values of cognitive outcomes in large-scale assessments. Methods: Following Weirich et al. ("Nested multiple…

The purpose of this study is to determine the best IRT model [Rasch, 2PL, 3PL, 4PL and mixed IRT (2 and 3PL)] for the science and technology subtest of the Transition from Basic Education to Secondary Education (TEOG) exam, which is carried out at national level, it is also aimed to predict the item parameters under the best model. This study is a…

Public perception of "declining standards" in school-leaving examinations often accompanies increases in pass rates in schoolleaving examinations. "Declining standards" to the public means easier examination papers. The present study evaluates a South African attempt to estimate the level of difficulty, as distinct from…

Tatsuoka (1984) suggested several extended caution indices and their standardized versions that have been used as person-fit statistics by researchers such as Drasgow, Levine, and McLaughlin (1987), Glas and Meijer (2003), and Molenaar and Hoijtink (1990). However, these indices are only defined for tests with dichotomous items. This paper extends…

Empirically supported multimedia learning (MML) principles [1] suggest effective ways to design instruction, generally for elements on the order of a graphic or an activity. We examined whether the positive impact of MML could be detected in larger instructional units from a MOOC. We coded instructional design (ID) features corresponding to MML…

Designing standardized exams for EFL undergraduates is a matter of great concern in pedagogical practices that assess learners' academic achievements. This case study was conducted at Majmaah University, Saudi Arabia, to explore the significance of educational exam standardization and its impact on the process of implementation, leading to a…

Researchers often use self-reported instruments to collect data from students when investigating the causes and effects of bullying. When completing the instrument, students may skip items despite anonymous data collection. To interpret data accurately, researchers must identify the causes of nonresponse. This study examined the impact of item…

Technology integration has become increasingly prevalent in language education and technology teaching tools are currently used for English instruction. In line with this trend, it is also believed to be influential in teaching and learning pronunciation. To cast an empirical light on this issue, this study aimed to analyse the influence of…

This study aims to investigate the test scores of the three-tier diagnostic chemistry test (TDCT)[three-tier diagnostic tests] and multiple choice chemistry test (MCCT) by response change behaviour (RCB). The study is a descriptive research study aiming to investigate the item response efforts of TDCT[three-tier diagnostic tests] and MCCT in a…

The home learning environment (HLE) index is composed of seven questions regarding educational parent-child interactions. To compare the psychometric characteristics of the six items of HLE index between the two different contexts of Germany and Iran, a sample including 468 preschool children from the National Educational Panel Study (NEPS),…

This study examines the relationships among various major factors that may affect the difficulty level of language tests in an attempt to enhance the robustness of item difficulty estimation, which constitutes a crucial factor ensuring the equivalency of high-stakes tests. The observed difficulties of the reading and listening sections of two EFL…

Previous studies examined the association between motivational characteristics and language learning achievement, but considerably less is known about young language learners' task-specific motivation in assessment contexts. Our study investigated the task motivation of young learners of English when completing computer-administered integrated…